How are mercury batteries hazardous to the environment?

Mercury itself is very poisonous. It collects in meat and tissue, as well, so mercury can carry over from anything that has consumed it. Fish are known for leading to mercury poisoning.