Why is the nullarbor plain riddled with limestone caves?

You'd need to consult the area's geology map to understand fully, but very simply there must be a bed of impervious & impermeable rock lying below the limestone that actually holds the caves, to keep the cave-forming water up in the limestone's formation.