Why did many southerners consider Uncle Tom's Cabin misleading?

By all accounts, Southerners did not consider Uncle Tom's Cabin to be misleading. Their objections surrounded the fact that the novel was an anti-slavery book. To them, the novel's popularity in the North confirmed their belief that many people in the North were against slavery.