Why does cloud formation occur higher up?

Because clouds occur when water condenses from water vapour to tiny water droplets. Water condenses when it is cold enough, and higher up in the atmosphere, it is colder.