A narrow deep waterway connecting two boddies of water or the deepies part of a river waterway?

The term you're describing is a "strait," which refers to a narrow, deep waterway that connects two larger bodies of water. Additionally, when referring to the deepest parts of a river, it is often called a "channel." Both terms highlight the significance of these waterways in navigation and ecology.