Is underground river a proper noun?

No, the compound noun 'underground river' is a common noun, a Word for any underground river anywhere.

A proper noun is the name of a person, a place, a thing, or a title. The River Fleet is an underground river that runs under London, UK. The River Fleet is a proper noun.