Why do people say they are dirt poor?

If a person says they are dirt poor, it means that they are extremely poor. It indicates that they have dirt, but not much else.