Can oxygen give you a headache?

No, oxygen itself does not cause headaches. However, breathing in air that is low in oxygen or high in pollutants can sometimes lead to headaches.