Can you drink wine with crystals on wine cork?

Sure, the crystals are tartaric acid which occurs in wine naturally. It is perfectly fine to drink the wine. You might even enjoy the crystals.