What will usually remove the magnetic properties from a permanent magnet?

The question refers to the "following". In such circumstances would it be too much to expect that you make sure that there is something that is following?