Why are men only attracted to pretty girls?

They aren't. The first-impression attraction depends much on looks of course, just as it does for women, but if that doesn't light the fireworks for him the girl can still be attractive through the behavior she shows and her personality.