What is the name of the part that sticks out on a puzzle piece?

The part that sticks out on a puzzle piece is called a "tab." Tabs interlock with the "blank" or "socket" parts of other puzzle pieces, allowing them to connect and fit together to form a complete image.