What is the meaning of the expression tee off?

The little holder for a Golf ball is called a tee - when you tee off, you start a golf game by hitting the ball off of the holder.