Is it normal for the gas grill regulator to get cold?

Yes the propane(or any other gas) is liquid for most of it's journey from tank to your stove. for that gas t be liquid it needs to be cold. The cold regulator is just the liquid propane chilling the regulator. The only hot part is when the gas is ignited.