What can you buy at the store to clean oxidation from from car headlights?

First, scrub them thoroughly with warm, soapy water. That's half the battle. Then, at an auto specialties store, get a liquid product called "Plast-ex", or a similar product called "Novus Number 2". They take elbow grease, but when you're done, the lenses will look factory new again.