Why are helicopters so hard to fly?

Hard compared to what? It's all about learning. I can fly a rotary aircraft but can't fly a fixed wing to save my life. There's a big difference in the overall feel of the aircraft.