Does the stinger from a bee or wasp need to come out?

A wasp withdraws its stinger so there is nothing to come out. However, the stinger of a honey bee remains in your skin and should be removed as quickly as possible as it will be pumping venom until it is removed. It will also turn septic eventually if it isn't removed. Incidentally, the honey bee dies after it has stung you becaue its stinger is ripped from its body in the process of stinging.