Is reindeer a singular or plural word?

Yes, reindeer is a countable noun; however, like the noun deer, the singular and the plural are spelled the same: one reindeer, eight reindeer.

A uncountable noun (or mass noun) is noun for a substance or concept that is indivisible into countable units, Words like water and knowledge.