Why do Jews cover their head when they pray?

Men cover their heads as a reminder of the fact that there is a being "above them", i.e. G-d.

Religious Jewish men cover their heads all the time, not only while praying.