Why did people think men and women were witches?

It was mainly found in the common folk who would receive the not so good crops to eat and would contain a fungus that would cause the behavior mistaken for witchery. Even the animals that ate the scraps would be mistaken as posessed. There is a documentry on it.