Does a purple sweater go with a magenta shirt?

Of course you can. However, some people might think that it doesn't match and it is unstylish. If I were you though, I would be more concerned with whether it looked good to me, and whether I was comfortable in it. Everyone can have their own style.