Is it difficult for horses to walk backwards?

No, not really. It isn't a natural gait, yet through domestication over many hundreds of years, it has become much less difficult than it was when they were wild.