Can mold on a neighbors house effect your house?

Yes it can harm your home since mold is a fungi it will release spores which are easily spread by the wind, humans, animals. Spores can get stuck on a person leaving their home and then be carried by the wind over to your house, if you have a window open or are outside then there's a good possibility that the spores will get in your home.