How much is a new hot water heater?

It partly depends on the type of heater. Many use 220 volts. Some of the smaller ones run on 110 v. Either way, you may have to install an electrical outlet. That is the main expense. The actual Plumbing part only needs two connectors and minor piping alterations.