Why are retrospective laws unfair?

Because the founders recognized the natural right to weigh the consequences of individual action beforehand. Ex post facto laws, remove that right from the individual, as no one would be able to say for certain what the law would be tomorrow.