Does an earthquake occur only in continental crust?

No, earthquakes can occur anywhere in the crust, oceanic crust or continental crust. An earthquake occurs when the hard brittle solid material of the crust fractures under stress.

Earthquakes cannot occur deeper than the crust (the mantle is plastic and flows slowly under stress instead of fracturing, the outer core is liquid and flows even easier than the mantle).