How can you stop weeds growing through gravel driveway?

Lately I have been wondering how much damage pine needles and leaves will cause to a gravel driveway if not raked or blown away in the fall and left to sit and decompose. I have a sneaky suspicion that the leaves and needles break down year after year and deposit quite a bit of soil into the gravel if left unattended. This year I decided to rake it all up. We'll see. Anyone else have an opinion?