Why swimming or survival floating will hasten the onset of hypothermia in cold water?

Body heat will be unable to warm the water around it, as fresh water will rush in to replace it. Were one wearing a waterproof suit, the body could heat the thin layer of water trapped inside the suit, but without such equipment the water will quickly bring on hypothermia.