Do you say a or an exercise book?

You would say "an exercise book." This is because "exercise" begins with a vowel sound, so you use "an" before it to make it easier to say.