Why do kittens hold their tail up?

A cat's tail is his center of balance. If it is messed with, it can even make the cat feel dizzy.