Is boiling water for tea a chemical or physical change?

This is a physical change. Water can take on 3 forms, ice, gas, and liquid. These would be changes in state.

Tearing, scratching, crushing, change in state, are all physical changes.

Chemical changes must change the substance, not just the appearance.

(i.e. Burning fire into ashes, fireworks exploding...)