How was nullification a threat to the union?

In the Constitution, it states that Federal law was supreme over State law. Therefore, the power for a state to nullify a federal law would go against the Constitution.