How did European expansion affect the Aztecs and the Incas?

The Spanish pretty much tried to plunder the Aztecs, resulting in their city in ruins after they finally managed to drive them again. If the Spanish did not try to conquer them for their gold, the Aztecs might just have grown out to become the dominant empire in North America.