Why does the government want to encourage exports?

One possible reason may be if the country has a deficit balance of payment. This means that it imports more than it exports and as a consequences, the exchange rate depreciates (the value of the country's currency falls compared to another currency). In order to have an exchange rate appreciation, an equality between imports and exports is needed and so, the government encourages exports.