Why is the electricity stored inside a battery called potential energy?

The energy (not exactly electricity) stored in a battery is stored in the form of chemical energy. Chemical energy is a type of potential energy, since it depends on the forces between atoms.