Is it worth the extra to build a 6 inch exterior wall?

It depends on where you live. If you are in a colder climate the up front cost of the 2x6 lumber will pay off over time. The extra insulation will be worth it.