Will social security penalize if vacation pay and unemployment put you over the earnings limit?

If vacation you are forced to use and unemployment benefits put a person over the $14,100 yearly earning limit is there a penalty ? Does vacation pay and unemployment count toward yearly income?