What makes the starter run constantly?

It's possible that it was wired wrong when the starter was changed. If you connect the small wires to the wrong place it will run, as you say, constantly.

IF it was functioning properly for a while and this is a NEW condition, it's probably the solenoid. If that's the case, just replace the starter since the solenoid is built in most of today's starters.