How can you tell if you are being spied on?

You may notice one particular person or a group of people around you reapeatedly. Even if you're talking to someone in, for example, a cafe - you'd feel their gaze upon you...something to do with senses.