If you give a website your Postal Code will you get unwanted mail?

I have provided my e-mail address to USPS in order to buy stamps online. They have not sent any unwanted mail.

There is a better option: Get a free e-mail account (Hotmail or Yahoo) and use that one when you must provide an e-mail address to do business with an online company.