Why did slave owners oppose the Wilmot Proviso?

They opposed it because that the inevitable addition of new free states to the Union would shift the balance of power permanently to the North. But, it was rejected by the Senate anyways.

Also some believed that it undermined their constitional rights because they believed slaves were property.