What does on the water mean?

it means that you are on it swimming

Swimming is usually thought of as in the water, not on it.

"On the water" means that you are somewhere out on top of it, usually boating. It can also mean that you are staying in a house that is right beside the water.