Why is it illegal to deface currency?

In the US it is not as long as it isn't used for fraud. For example, you're allowed to make a flat penny as a souvenir, but you couldn't take a penny and shave it down and use it in a vending machine as a dime.