If you go to jail for not paying taxes do you still owe the taxes when you get out?

Of course you do, plus penal;ty and interest.

Your jail is for the crime of trying to avoid taxes, not in lieu of paying them.