When is it a good idea to get travel insurance?

I think, no matter where you are going, if you are going to be gone on an expensive vacation, it is always worth it to get travel insurance. Bad things can happen at the last moment, and it would be nice to have your money back if need be.