Why can bacteria evolve so quickly?

Insects and bacteria are said to evolve faster than some more complex animals because they reproduce faster. Simply put the more offspring you can make, the faster they mature and make new offspring with selected genes, then the faster they can evolve.