Is warm tap water safe to drink?

It's the same water from the same source, regardless of whether it is cold or hot.

If the water is properly treated and filtered then it is safe. If it is not treated correctly, it is not safe.