What does it mean if a baby body is warm but not to hot?

Depends on how warm we're talking about. Babies usually run a higher temperature than adults (probably because they have better blood circulation). Take a rectal or axillary (armpit) temp reading. Anything under 101 is nothing to worry about. Between 101 & 103, use luke warm baths.