Why does the Chief Justice of the United States swear in the President at his or her inauguration?

The Chief Justice is head of the US Supreme Court, which is head of the Judicial Branch of government, so the choice of official is appropriate and traditional, but not required. The President may select someone else to issue the Oath of Office if he (or she) so desires.