Which way do you close the chimney damper?

Dampers are usually arranged to close DOWN, so that the weight of the damper keeps it closed. Use a flashlight- it helps to see what you are doing in that very dark place.