What state actually had two governments supporting both sides during the Civil War?

The state of Missouri had two governments and actively supported both sides during the Civil War. This caused conflict and battles within the state among it's residents.