What is the purpose of a dielectric in a capacitor?

Two functions - it provides electrical insulation, and it increases the capacitance, i.e., the amount of charge - and therefore also the amount of energy - that can be stored at a given voltage.