Where does the term old man come from?

The term "old man" is a colloquial way to refer to one's father and likely originated as a term of endearment or familiarity. It is a common way some individuals refer to their father in informal settings.