When water is frozen in plastic does the plastic expand?

No, so you will want to leave an inch or two when filling the bottle as well as leaving it uncovered until the water has frozen.