Can you water plants with tap water and it not be harmful?

Yes. If you can drink the water on a regular basis, so can plants. If there are impurities that are minerals, they might be helpful to a plant. If there is gas in the water, letting it sit out in an open container for a day will usually fix that, and heating it certainly will.