Is the mayor ultimately in charge of the police force?

No, the mayor is not ultimately in charge of the police force. In most cities, the police department is typically overseen by a police chief or commissioner who reports to the city government or a city council. The mayor may have some influence over the police department's budget and policies, but they do not have direct control over day-to-day operations.