Okay, from the room with the old man, go east and then continue going north as much as you can. Eventually you will reach a room with ponds on both sides. Press against the north wall and you will pass through it. Clearing THIS room reveals a staircase which (as I can remember it) holds the ladder.