What has to be taken away to change water into ice?

The freezing point of water is 0 C (32 F).

The difference between a liquid and a solid is the space between the atoms.

To become more dense (a solid) the orbit of the electrons has to become less. This requires losing energy. As energy cannot be made or destroyed, it has to be transferred. This removal of energy is the removal of heat.