When did they start Veterans Day started?

Well, it was originally called Armistice Day, which was first celebrated on November 11, 1919. It was meant to honor those that died in World War I. Then, on June 1 1954, the Word Armistice was changed to Veteran's day.

So, I suppose you can argue that it was either 1919 or 1954.