Once you stop phentermine will you gain weight?

Because Vyvanse is a medication that works the same day you take it I have gone through periods where I stopped. And I always ended up gaining weight. Not sure if the Vyvanse raised my metabolism, cut the hunger or I just had more will power on it. Likely a bit of all three.