Why did Americans oppose immigration during this time period?

There is always a certain amount of fear that immigrants are going to compete with Americans for jobs, and Americans will wind up unemployed as a result. Of course, an economy does not have only a specific number of jobs, and immigrants can also start new businesses and employ people, besides which, everybody is an immigrant or the descendant of immigrants (even Native Americans; they just immigrated earlier than anybody else).