If you have two 3.6v led lights do you need a 7.2v battery?

No. Volts is the "pressure" of the electricity. If a single 3.6v led required 20 milliamps (amps is the "amount" of electricity) you would need to supply two of them with 40 milliamps but at 3.6 volts.