Do silkworms live in dirt

No. The 'silkworm' is the caterpillar of the domesticated silkmoth which feeds on the leaves of the white mulberry plant.

Farmers grow the plant and feed the leaves to the silkworms which are kept in flat baskets in their houses.

Thus far form living in dirt, silkworms live in baskets and are cared for by silkworm farmers.

see related link below for more information.