What long term damage am i doing if i don't use my inhaler when my chest is tight?

You are placing a great deal of stress on your heart, as it struggles to get oxygen to all the cells. It will pump faster and harder to compensate for the less air getting into the lungs. And it can cause you to pass out due to lack of oxygen, which can lead to permanent damage to the body.