Should the Atlantic ocean be capitalized?

Yes, "Atlantic Ocean" should be capitalized because it is a proper noun referring to a specific body of water. When naming oceans, seas, and other geographical features, it is standard to capitalize their names. Therefore, you should write "the Atlantic Ocean" with both "Atlantic" and "Ocean" capitalized.