Can one have the passport of a country but he is not a citizen of that country?

Generally one has to be a citizen of a country to hold a passport of a country. Exceptions are few, but include refugees who can be given temporary papers by a country.

People can be citizens of several countries at the same time and hold several different passports at the same time.