Is water the medium for earthquake waves?

No. Seismic waves travel through rock and sediment.

Sea waves (tsunamis) are not generated by earthquake vibrations, but by the displacement of ocean water, which leads to the formation of waves when the crest reaches shallower water.