Why do borders follow old rivers?

They traditionally tend to be obstacles that make it difficult for opposing armies to pass, they're also natural landmarks, making it easier for the book keepers and mapmakers.