Who can fire the chairman of the federal reserve board?

The president does have the power to remove a member of the Board of Governors, but only for cause. Cause in this case would mean something like the chairman got the keys to the vault and was found stuffing his pockets with bullion.