How can an upside-down exclamation point be created using the keyboard?

Make sure your Number Lock is on. Hold down the Alt button. Use the number pad on your keyboard (not the top row) and enter the numbers 173, then release the Alt key. Your upside-down exclamation point will then appear.

This type of character is called an ALT character. There is an entire list of various characters at the Related link below.