Why is my hot water rusty colored?

You have iron in your water. When you heat the water and it mixes with oxygen it becomes rust. You can try different types of filters and water softeners to try and stop it but they have mixed results depending upon how much iron you have in your water.