How does riding a bike on an athletics track damage it?

Not if you're riding with care. Skidding can damage the surface though. And whoever that's in charge of the track might not want to share it with bicyclists.