Do you think we could do without worms bacteria and other decomposers?

No. The decomposers are critical in replacing nutrients in the soil that are absorbed by plants. Without the decomposers, the surface of the earth would rather rapidly turn into nothing but desert.