Who in society determines what behavior is and is not deviant?

no one. society generally decides if someone comes across as polite or not. the person can be many things.