Why does a spray of water come out of mouth when yawning?

The sublingual caruncle is found under your tongue (either side of the frenulum - the small folds going from your tongue and the cavity floor).

This is where two salivary glands, the sublingual and submandibular glands, empty into the oral cavity. That is why saliva will sometimes spray out when you lift your tongue while yawning.