Why does the starter continue to run even when the key is turned off?

Sounds like the starter solenoid is sticking, could be faulty. You might have to pull it out and bench test it. First put a multimeter or test light on the starter solenoid wire (without it being connected to the starter) and check that it stops supplying power when you switch the key off to make sure you don't have any wiring issues.