Is the National Anthem protected by copyright or can you use it in your novel that you hope to publish?

The pieces of music themselves are not copyrighted, they are in the public domain.

However, a PERFORMANCE of the National Anthem may very well be copyrighted.

You could use the TUNE of a National Anthem in a newly composed piece, but you could not use someone's arrangement of the National Anthem without their express, written permission.