Is expectantly an abstract noun

No, the Word 'expectantly' is the adverb form of the adjective 'expectant'.

The abstract noun forms are expectancy and expectation.

The Words 'expectant' and 'expectance' are obsolete noun forms.