Plant with purple berries and purple and white hanging flowers?

You shouldn't have to pick the flower - It sounds like you have a Solanum dulcamara L., or bittersweet nightshade. These can be poisonous. Check http://wisplants.uwsp.edu/scripts/detail.asp?SpCode=SOLDUL to see if that's the plant you're talking about.