What does the idiom to go red in the face mean?

Your face usually turns red when you are embarrassed, so this phrase means that someone was ashamed of something.