What happened to Joseph the husband of the Virgin Mary?

After the finding of Jesus in the temple at the age of 12, there is no further mention of him in scriptures. It is then to be assumed that he passed away sometime after that and before Christ began his public ministry.