Press X to move and Z to jump. You can change the direction you walk by walking into the wall. When hovering over a large gap, hold X or Z to fall down.
Can you make it out of the cave with only two buttons?