Do buyers and sellers as one group determine demand but only seller determine supply?

Yes. Buyers want a product and those that sell it regulate how much of it they sell to the buyers, therefore controlling the supply as a result of the demand.