Why did unions decide to celebrate Labor Day at the beginning of September?

The first Labor Day was held on September 5, 1882 in New York City by American labor leader Peter J. McGuire. McGuire had witnessed Canadian labor union parades and strikes and decided to bring organize a labor day in America to honor workers and give them a day of rest.

The holiday has been held on the first Monday of September ever since.