You start the game just outside a building. Enter the building and you'll find some keys. Take those, then go out of the building and explore around. You should find a stream. At that point, follow it downstream (type downstream) until you get to a grate in the ground. Unlock the grate; that's the entrance to the cave.