What makes a capital city a capital city?

Usually, this is where the center of the government is located: where you will find the state house or the legislature. In the past, these cities were chosen because they were in a central location in a state (easy to get to from all parts of the state) or because they were the hometown of the state's founder or most important person.