What year did horseback riding become a sport?

That was the 1900 Games in Paris, France. Three events were contested, individual show jumping, high jump, and long jump. There was no equestrian in the 1904 and 1908 Games. It made its comeback in 1912 and has been a part of the Olympics ever since.