Space - Book keeping is infamously space consuming, filing cabinets full of paper can be condensed into a single file on a laptop.
Speed - Book keeping normally features calculations which a spreadsheet when set up with the correct functions can do them automatically as data is entered.
Accuracy - Because the calculations are copied and automated, there would be no user input, and thus no chance of someone forgetting to carry a 1 in the calculations.
Statistics - Having the data all in one place makes it far easier than scrolling through a filing cabinet to find out what the most commonly sold item in your company is.
Backup - Backing up a file to a secondary location is as simple as two clicks, try doing that with an office fill of paper files.