Why does the battery voltage decrease as a battery becomes discharged?

One volt is a joule per coulomb, therefore over time the battery looses electrical energy (joule) and this is why the battery becomes discharged.

put simply it is because the electrical energy is being consumed.