What was the last confederate victory?

It was won at Chickamauga.

No, actually, technically, the last confederate victory happened a few months after the Lee's surrender at Palmino Ranch in Texas. The last recorded casuality was a Union soldier at that battle.