Is it illegal to throw mail away?

Yes, it is illegal to throw away someone else's mail. It is a federal offense to tamper with or destroy mail that is not addressed to you.