Can you use regular AA batteries for outdoor solar lights?

If I understand the type of light you seem to be referring to correctly, the answer is no you need rechargeable AA batteries (e.g. NiMH). Normal AA batteries (e.g. alkaline, heavy duty) are not rechargeable and can be damaged or even explodeif it is attempted to recharge them.

Use only the type of batteries the instructions for such devices specify.