Does a golfer have to remove their ball from the hole before another golfer can putt to that hole?

There is no requirement that the ball be removed, but it is considered good Golf etiquette. As pointed out by one commentator, why deprive someone of that glorious sound of a ball hitting the bottom of the cup after all the hazards, mulligans and lost balls?