It is against the law to follow an emergency vehicle?

Yes if you are just following it to see where it is going. It is however not illegal to be going in the same direction as an emergency vehicle as long as you stay 500 feet back.

If the emergency vehicle is not using its emergency lights or sirens, and is not stopped at an emergency scene, you can treat it like a regular vehicle and follow it as would be legal for any other vehicle.