Do temporary licenses expire once you get your permanent one in the mail?

Even if they do not expire why would you want too keep the temporary license once you have the permanent one?

Yes.