Is a change in the temperature a physical change?

Not necessarily. It does, however, indicate that a reaction is taking place.