Why the rich whute man didnt want to end slavery?

Because it meant nice cheap labour for the lucrative cotton trade.

There were also poor white trash who didn't want to end slavery, because it meant there would always be someone lower than them.