What is the difference between witches and herbalists?

I think the difference is that an herbalist has a different set of beliefs one is based around a religion (wicca) one is just about the herbs themselves and what they can do.. But I found your question because I was searching for an answer to the exact same question so I may very well be wrong..