Is an goldfish a vertebrate or invertebrate?

Goldfish, like all fish, are vertebrates because they have an internal skeleton with a vertebral column (backbone) which is a major characteristic of vertebrates.

For additional information on vertebrates and invertebrates see the related questions.
Yes, goldfish are vertebrates as they have a bony spine.
It is a vertebrate. it has a spinal column.