Is the mistress wrong for sleeping with him?

What if, as the mistress, you found out that the man is also taking another mistress on the side? How would you feel? Suddenly, you're not special. Suddenly, you realize that this man just doesn't know how to be faithful. So, is it wrong for thatmistress to be sleeping with him? If so, why?