Which class of people held all the power and made all the rules in the Greek city-states?

It depended on the different forms of government for different city-states at different times. There was monarchy (heriditary kings), oligarchy (aristocracies), tyranny (compromise governors to control the aristocrats), democracy (the citizens in assembly making the decisions).