How should you remove a bee stinger?

Yes, scrape it off with a thumbnail or something like the back of a knife or the edge of a credit card.

In fact, it is important to do this as quickly as possible because even when the bee has gone, the stinger and venom sac remain and will carry on pumping venom into the wound for up to a minute, so the longer you wait, the worse the sting.