Is it illegal to throw away previous tenants' mail?

Yes, it is illegal to throw away mail that is not addressed to you, including mail for previous tenants. It is a violation of federal law to tamper with or destroy mail that does not belong to you. It is recommended to either return the mail to the sender or write "Return to Sender - Not at this Address" and place it back in the mailbox for the postal service to handle.