Why would dirt be coming out of the hot water tap in the bathroom?

The most likeliest answer to this question would be that your hot water heater is unfortunately rusting or perishing from the inside, no amount of cleaning will help. your only option is to replace the hot water heater.