Can you write the plural of ski as ski's and be correct?

No. Apostrophes are almost never used to form a plural.

The spelling ski's is a possessive noun, e.g.

He has to be careful of his left ski's position on the last turn.

His right ski's color is black and his left ski's color is white.