How does fertilizer kill fish and other aquatic life?

Fertilizer IS nutrient rich. When it gets into lakes and ponds, it causes massive algae blooms. These massive algae blooms soon die off, contributing to massive amounts of carbon dioxide accumulating in the lake or pond (and thus a decrease in oxygen concentration). Such a decline in oxygen concentration will suffocate fish and thus cause fish kills.