Where did the wealth of the roman empire come from?

The other way around - they got their money from building an empire. Each new territory produced land, loot, slaves and ongoing taxes.