Is workbook a countable noun

Yes, "workbook" is a countable noun. You can use it in the singular form (e.g., "a workbook") or in the plural form (e.g., "two workbooks").