Is sleepily an adverb

Yes. It is the adverb form of the adjective sleepy.

Sample sentences:

Imagine waking up at a civilized hour, walking around sleepily as the coffee jug boils. (sleepily modifies the verb walking)

Her thick-lashed eyes look sleepily docile. (sleepily modifies the adjective docile)