What causes you starter on a riding lawn mower to stay engaged after shutting off the key?

Sounds like a bad ignition switch. It could also be a bad starter solenoid. If you can find the solenoid you can unplug one of the small wires while it is trying to crank over and see if it stops. If it does it is probably the switch. If it doesn't then it is probably the solenoid.