Does selective cross breeding cause infertility?

No, in most cases it doesn't. Cross-breeding is actually supposed to enhance fertility, especially when crossing on purebreed with another to get an F1 animal.