Why did caves make good shelter for the early settles?

Provided their entrances are dry, caves shelter you from the weather and provide some protection from dangerous wild animals.