Is tic tac toe a fair game?

Yes. An optimal opponent can guarantee a tie regardless of whether or not it goes first.

To come to that conclusion, I ran the Minimax algorithm against itself for all 9 possible starting game states and each game resulted in a tie.