Why do people call you Mr when you are a 23 year old guy?

Probably because you look like a grown man, and (in the U.S. at least) we refer to men we don't know as "mister" or "sir".