Why would people not want to build a quarry near their house?

Dust, sounds from trucks loading from the quarry, skip loaders making sounds,just the constant dust and sounds.