How can someone tell if an ac relay fuse is blown?

A relay does not have a fuse. The circuit for the particular relay is fused.

You can tell if the fuse is blown by testing it with an ohm meter.