How do you know when your fireplace chimney needs to be cleaned?

If a fireplace is only being used once a week or for only a few hours at a time, it is necessary to only have a cleaning once evey two to three years. However, if there is soot coming down when opening and closing the damper, this is a good determining factor that the fireplace/chimney is in need of cleaning.