Is it illegal for debt collectors to go to your neighbors house?

I don't believe it is illegal, however, if your neighbors are finding it a bother, i think they can forbid them to come again, and if disregaurded then they can take legal action