When were gypsies first persecuted?

Probably all the way back when their ancestors were labelled "Dhalit"("untouchable"), hence their decision to leave India.

From there on, they experienced persecution every where they went.