Can you cross the international borders in a rental car?

Check your particular rental contract/agreement. Most stipulate that you can't, and it makes good sense. Be honest with the rental agency ... ask them if it's okay to cross a border with their vehicle.