Why Milk souring is a physical change?

It is not physical but rather chemical: milk sugar (lactose) is converted to lactic acid by Lactobacillus bacteria.