Was there apple trees in caveman time?

Yes, strictly speaking, fruits are a means for flowering plants to distribute their seed through animal dung. It is quite likely that some of our ancestors were animals that primarily subsisted on fruit for their diets. Fruit predates humanity and human history, and is as such "pre-historic".