Can I throw away old tenants' mail?

No, it is illegal to throw away mail that is not addressed to you. You should either return it to the sender or write "Return to Sender" on the envelope and put it back in the mailbox.