Is North in North Mississippi capitalized?

Yes, "North" in "North Mississippi" should be capitalized because it is part of the proper noun that specifies a specific location within Mississippi.