Is it illegal to keep mail that isn't yours?

Yes, it is illegal to keep mail that isn't addressed to you. It is a federal offense to intentionally open or withhold someone else's mail.