What is the difference between gulf and peninsula?

A Gulf is a place where the sea sticks into the land. A peninsula is where the land sticks out into the sea.

See, for example, the Gulf of Mexico and the Yucatan PENINSULA.

Peninsula - Latin paene (nearly) insula (island). Connected to the mainland by a thin strip of land called an ISTHMUS.