Are North and South capitalized when writing of the Civil War?

When you are talking about the sides in the war, yes. If you are referring to the direction, they moved north, not. If you say they joined the North, yes.