Is cyberspace located in or over the oceans?

Yes and no. The only part located in the ocean would be the submarine cables used to connect different counties together. Some aircraft and satellites (which could be over the oceans at times) may provide internet access and so could perhaps be called "cyberspace".