Should you close the flue to the fireplace to keep the humidity out of the house?

The purpose of the fireplace damper is to keep the outside elements, outside. The damper is opened only when there is a fire in the fireplace.