Does a doctor have to withdraw a patient if he wants to date them?

Yes they do.

"At a minimum, a physician's ethical duties include terminating the physician-patient relationship before initiating a dating, romantic, or sexual relationship with a patient."

Read more: Is_it_okay_for_a_doctor_to_date_their_patient