What is the little metal thing that holds a lampshade on a lamp called?

It's called a lamp harp.

The top (where you place the shade) is called a finial base, the little 'clips' at the bottom are called the harp base.