What do you call the nurse who cleans the babies when they are born?

A midwife.

A midwife usually attends a mother during pregnancy and birth. If the baby is born in a hospital, it would be the neonatal, maternity, or motherbaby nurses, depending on the setup of the hospital.