Why do we refer to a judge as "Your Honor"?

The title "Your Honor" is used to show respect and acknowledge the authority and impartiality of a judge in a court of law.