What is meant by the North and South in reference to the Civil War?

The South was the Confederacy - the eleven states that had seceded from the USA.

The North meant all the other states, and these included four states of the Upper South that had remained loyal. But their loyalty was often uncertain (a major worry to Lincoln), and all of them recruited some regiments of Confederates.