Go swimming with poison oak sore?

If you are swimming in clean, chlorinated water this would be safe. If the water is not very clean, then there is a risk of exposing your sore to an infection. Personally, I would wait for the sore to heal.