How do you get ruffians out your garden on viva pinata?

buy a dastardos head shovel at the beggars store before you do anything, when a ruffian comes give him 1 coin and hit him repeatedly.

hope this helps.