Is it legal for the insurance company not to pay the loan company on a totaled car?

Yes. The insurance policy is a contract. All it requires the insurance company to do is to pay the fair market value of the vehicle. You would need to get what is called gap insurance to pay the difference between the market value and the loan value.