Why does the exclamation point represent a factorial?

The exclamation mark is used to state the variable preceding it is a factorial. x! = x * (x-1) * (x-2) ... (1)