What does it mean when a man calls you ma'am?

It means you are older than a Miss and it is a sign of respect. It also means that he is a stranger. Guys don't call people they know Ma'am.