Why do fish eat their young?

Not all species of fish do eat their young. In the majority of cases the ones that do eat their fry are simply not recognising their fry as theirs, and to them anything small enough to eat is considered fair pickings. I guess it adds up to the "survival of the fittest" and the "quick and the dead".