Would late be considered an adverb?

It can be, but it is also an adjective (along with later).

The Word lately no long means done in a late manner.

Examples:

He was late for the meeting. (adjective)

They scored late in the game (adverb).