Do you have to capitalize Halloween?

No you shouldn't. Party is a common noun which is not capitalized. Halloween party is then saying Halloween is a proper adjective not making party part of the title.