What should you do if your spouse constantly throws the past in your face?

Take a chance! Tell him "if my past bothers you, why don't we break it up! You see, your past should not be used as a weapon against you for the rest of your life. You can't permit that. You must make it clear that this sort of leverage is highly unfair because to connect the present to the past, without really knowing the conditions of that past, makes it totally irrelevant and highly prejudicial. You must speak up! You must tell your spouse that without having lived through your past, his judgments are highly inappropriate. But also listen to his answer and consider that we all like to blame others for our own failures. Read more about the "Tit for Tat" resolutions in Meyer's "Marriages, Shack-ups and Other Disasters."