What does it mean to follow someone on Twitter?

To follow someone on Twitter, simply means you receive updates from that person/group.

Updates on Twitter are short messages (140 characters or less). These updates are known as tweets. And anyone who follows you will see your tweets you have made on their wall when they sign in.