Does window have a long vowel sound?

Yes, the O in window is a long O (oh), as in the Words low, grow, and stow.

The I is a short I sound (in, win).