Are birds the only vertebrates that lay eggs?

No. The whole reptile family, and bony fish. Also, its possibly pushing the definition of eggs, but amphibians spawn.