What is the reason for laying a stone aggregate around a railway track?

Fine aggregate mimics the (real-life) crushed stone 'ballast' used to spread the load of a train over as wide an area as possible. If the rails were just laid on bare ground, they would sink as soon as a train passed over them.