What special advantages does a physical capitol offer?

It gets a state or country a large building to house the various branches of that government.

Places for offices, meeting rooms, and places to house the documents that rule that state or country.