Can you die from a hard smack to the chest?

yes you can. a hard enough punch could cause your ribcage to cave in slightly and hit your heart, causing damage to the heart and causing it to beat irregularly, thereby killing you.