What is a device for catching things take away one letter from stamp?

A device for catching things that takes away one letter from "stamp" is "trap." By removing the letter 's' from "stamp," you get "tamp," which is a technique used in trapping to secure or compact something, but the primary answer remains "trap," which directly refers to a device used for capturing animals or objects.