Is the word baby an adverb?

No, a baby is a person, so "baby" is a noun.

Adverb are Words which modify (give more information about) a verb.

Example:

She ran quickly.