Will hairspray kill a yellow jacket?

Chemically, no. But if the spray blocks the yellow jacket's spiracles (breathing holes) it would eventually die.
There is the old joke about using hairspray on flies doesn't kill them, but turns flies into gliders...