What does it mean to scale a building?

To scale a building means to climb it by means of a ladder, or to reach the highest point. This term is often used in reference to attacking a castle - to "scale a castle wall" when attacking.