Why was Kiam mad when their family was in the alley way in the Jade Peony story?

Kiam was mad when their family was in the alley way because he was ashamed that his Grandmother and Sek-Lung were looking through the trash. He was worried of what other people would think of them doing this and he stated that they were beggars.