Is most of the water on Earth underground?

If you count the water that is mixed in with the rock of the mantle, yes. Otherwise, no. Most of the water is in the ocean.