Where will the CPU store data for easy access and quick retrieval during these computations?

CPU's will have a number of small local data storage points called "registers". These registers only hold small amounts of data and provide the fastest possible access.