What source keeps the planets from flying out of the solar system?

Gravity. If you want to know why you should look up Newton's laws of gravity all three of them.