Is too loudly an adverb phrase?

Yes, "too loudly" is an adverb phrase that modifies the verb. It indicates the degree or intensity of the action being performed.