Is it normal for a newborn boy not to have an erection?

Yes, the natural penis is flaccid. The penis will have erections or part erections from time to time as part of a natural healthy body. He may be having them when you do not notice or he may not, it's nothing to worry about.