What southern states had slavery?

All the Southern states had slavery. But not all of them joined the Confederacy.

Kentucky, Missouri, Maryland and Delaware remained loyal - a very big factor in the Union victory.