Is on the table a phrase?

Yes, "on the table" is a prepositional phrase. It provides information about the location or position of something in relation to the table.