From where would one be able to purchase a paddle for a kayak?

Any sporting goods store, like Dick's Sporting Goods and Gander Mountain will carry kayak paddles. They can be found either in store or online. Another place to check would be a boating store. If they sell kayaks, chances are they will sell the paddles as well.