Why are private schools called public?

They aren't. Public schools are the schools that you pay for with your taxes. Private schools are the ones that you have to pay extra to go to.