Is Columbia river a proper noun?

Yes, the compound noun 'Columbia River' is a proper noun, the name of a specific river.

A proper noun is the name or title of a specific person, place or thing. A proper noun is always capitalized.

All of the Words of a compound proper noun are capitalized.