Do you have to claim unemployment compensation overpayment since you have to pay it back?

You probably do, because receiving the overpayment and the paying it back might be in 2 different reporting periods. Better to report it and then get the credit later for having paid it back.