Is prayer book a compound noun?

Yes, "prayer book" is a compound noun because it is made up of two Words (prayer + book) that come together to form a single noun to refer to a book containing prayers or religious texts.