What is the only sea creature to have an ivory tusk?

The Walrus. Actually they are enormous elongated upper canine teeth forming heavy tusks.

The narwhal, a small whale species, also has a tusk protruding from the front of the mouth, like a unicorn's horn protrudes from the forehead. But only males have this appendage.