What can a CPA do that no one else can do?

Produce CERTIFIED Financial Statements. Most financial institutions that make business loans will require financial statements that are "Certified". Thus a regular Public Accountant would not suffice.