Why is gambling in horse racing haraam when there is risk and hard work involved in it?

Gambling on horses is not considered haraam for the horse owner, just for the by-stander.