Why was David's dad so upset when the government approved horses in the Chrysalids?

Because the horses were bigger, stronger, and faster than most horses... in other Words, deviant mutants, and he truthfully believed that any deviation from the norm was evil.