Do breasts shrink after stop using estrogen pills?

I was taking Birth Control which has estrogen in it for about 2 years and my boobs grew 2 full cup sizes but a few months ago i stopped taking it and they have shrunk a size... and seem to keep shrinking. =[ so i think it depends on if they made your boobs grow in the first place.