Is it illegal to open other peoples mail eventhough it comes to your address?

Technically yes. In practice, you can allow someone else to open your mail, and in some cases this permission is assumed in the absense of clear indications to the contrary: in a marriage spouses are typically regarded as having tacit permission to open each other's mail and parents are allowed to open their (minor) children's mail.