Why didn't president Taft agree to make Joe Cannon as Speaker of the House?

The Speaker of the House is elected by the House. Cannon was the House Speaker for the first two years of Taft's administration, but the Democrats won control of the House in 1910 and Cannon lost his job as speaker.