How do you clean water marks off a window?

If by "water marks" you mean the residue left from rain or splashing tap water, then white vinegar is your best bet.

Apply the white vinegar to the glass, then wipe off with balled-up newspaper.

The water marks are most probably "scale" or lime residue left when the water evaporated, and the white vinegar will dissolve the scale off the glass.