Do you have to claim a tax refund as income if you are on unemployment?

A tax refund is not income as defined by the IRS. However, if the taxes paid were claimed as a deduction in the income tax for that year, there is an adjustment to the AGI. Some states provide for counting this in the following year.