How is limestone formed in caves?

It isn't! Caves do not form rock at all!

Caves in limestoneare formed by the removal by dissolution of the rock by acidic ground-water.