Why did the NativistKnow-Nothing Party try to limit the rights of immigrants?

The know nothings were created out of opposition to immigrants to prevent flooding the country. They felt it would take away from jobs and weaken the country as a whole.