Why is the sun high in the sky at noon?

Well, you're looking at it backwards. The concept of "noon" is man-made. Noon describes that point during the day when the sun is directly (or nearly) overhead. So, to answer your question, the sun is high in the sky at noon because we define "noon" as that time during the day when the sun is high in the sky.