Is adding sugar to tea a chemical or physical change?

Yes it is a physical change. When the sugar is dissolved in the tea, the sugar retains its property of sweetness. And you could let the tea evaporate and you would have the original sugar left in the container.