What if a man owned more then 20 negros?

That was common. If you owned a Planation, it usually required a large work force to farm it. Senator John S. McCain (presedential candidate for 2008) had an ancestor named William Alexander McCain who owned a planation and 52 slaves. This has been verified by National Archive records and Census Records of Mississippi in 1860.