Why cant orbits change spontaneously?

For a change in orbit, a planet would have to experience an external force large enough. This would have to be a large collision with a rogue planet sized object or something like that - a highly unlikely event.