Why are there letters under some dates on pennies?

The letter indicates the Mint that struck the coin. Mint marks appear on all current U.S. coins except for cents that were struck at Philadelphia, PA and West Point, NY.

See for example http://www.coinworld.com/news/012306/bw_0123.asp