How did the old man kill the shark?

Assuming you are referring to the book The Old Man and the Sea, Santiago kills the first shark that attacks his captured fish with a harpoon. He loses the harpoon, so he makes a makeshift harpoon tying a knife to an oar. He kills several more sharks with this harpoon.