Is it correct to say do exercise referring to physical exercise?

Yes. When you are asked to exercise it means anything from walking, jogging, running, aerobics, bicycle riding, swimming, etc. These are considered to be a form of physical exercise.