Would you have to be a slave to be an abolitionist?

No, and most abolitionists were white, because most blacks were slaves. Some blacks might have contributed by doing stuff as an abolitionist, but an abolitionist did not have to be a slave. (More appropreatly slaves couldent, only freed slaves could do anything)