What is the correct usage - by phone or over phone?

"On the phone" refers to somebody's perspective, viewing somebody speaking into a phone. Over the phone refers to the specific method of communication in which you say something over the phone. In short, if you see somebody using a phone, you would use the phrase "on the phone" to describe it. To describe how a message was communicated, you would use the term "over the phone".