Will perennial plants left outside in pots come back?

Yes, as long as they're in a large enough pot and have enough dirt to protect the roots from freezing if you live in a northern climate. If you do have severe winter weather, you might consider putting the pots in a protected area close to the house and/or mounding the pots with leaves or mulch for extra protection.