What is the edible part of a ginger?

The bulbous parts you see in shops are actually called 'Rhizomes', however most places call them 'ginger root' to avoid confusion(the actual roots grow out of the Rhizomes, and they are rarely used in food).

The leaves can be used to flavour food, and the flowers are also edible.