What can create underground caves and form stalactites and stalagmites?

Water, erosion, and time. Limestone is a common rock that these geologic structures form in because of it's relative softness.