Is 'orange river' a compound noun?

Yes, Orange River is a compound noun (two or more Words combined to form a Word with a meaning of its own), and a proper noun, the name of a specific river. Proper nouns are always capitalized.