If you stop watering your petunias will the yellow leaves disappear?

It depends on what caused the yellow leaves.

Both dryness and overwatering can cause yellow leaves so if the plant is dry water it ,if it is sodden let it dry.