Are all cells and batteries the same size?

No, batteries and the electrochemical cells that make them up come in sizes from much smaller than a tiny button to much larger than a walk in closet, depending on their purpose, voltage, current ratings, and ampere hour capacity! They can weigh less than a gram to several tons!