What do you call a small half wild horse or pony?

Feral horse, most likely. Feral means half-wild, as an animal that was once domesticated has gone back into its wild state (but is not completely wild like true wild animals are).