Is it harmful to wear only one contact lens?

As a user of soft contact lenses for 10 years, yes it is. Using a lens that is anything less than perfect can lacerate (scratch) your eye, causing potentially irreversible damage. Even if the damage done is minor, it still hurts worse than just about anything you can think of, causes major light sensitivity and will keep you from sleep... worst week of my life.