Will it hurt to freeze memory foam?

From my personal experience with gel memory foam mattresses, when it came time to winter my mattress became increasingly firm and wouldnt even form into my body. So expectantly I had guessed that yes; the gel in my mattress just froze. But hey, maybe we have different brands; mines from costco, so that kind of makes a difference in the quality.