Why are rocks and soil poor heat sinks?

Rocks and soil are poor heat sinks because the materials they are composed of have only moderate specific thermal capacity and low thermal conductivity. However there is a lot of tonnage out there and heat pumps can be made to extract heat from the soil, but per ton these materials have less heat than water for example.