How do components get power?

A computer's power supply unit provides all needed voltages for the components of a computer that are internal.

Externals either draw power from the USB bus (which in turn gets it's power from the aforementioned PSU or a Hub with a power supply) OR have their own internal power supply with a cable.