How did mount Olympus form?

They never really say. Some accounts allude to it forming in the aftermath of the Titanomachy, but others indicate that Olympus and Othrys were the "bases" for the gods and Titans respectively, which means it already existed.