What is the purpose of the CMOS battery?

I think the battery you are talking about is also called a "BiOS Battery", and is used for keeping the BiOS settings of the computer stored properly, even when the usual power supply is removed. This means that you don't have to set the time etc. on your PC whenever you unplug it from the wall.