Was neatherthal man who lived in cave first?

Neanderthals and early humans lived in parallel, and both no doubt would have used any convenient cave as a home. I don't know what they did when they were far from any caves - presumably made shelters from tree-branches, animals skins and suchlike.