Is it safe to outsource my company's data for finance purposes?

Usually yes, but check out the company's data security protocols, especially if you're outsourcing to the developing world. If companies in those countries divulge your data, you may have difficulty taking legal action.