Why do you call a judge your honor?

I know when you address a judge in the court of law you refer to them as "your honor". This is because a judge is required to uphold the laws of the land, like an umpire at a Baseball game calls a strike or a ball. The judge is there to hold others accountable for their actions, but first to do this the judge has to be held accountable for their own actions. The judge is address as "your honor" because it has already been determined that the judge is an honorable person.