Phone music through headphones instead of speaker?

You can simply buy a headset for your phone, and plug it in. What I don't like is you only have one speaker. I know phone carriers sell actual headphones for cellular phones, but they're pretty pricy.