What is the feminine gender of billy?

In English there are no masculine or feminine forms. English uses gender specific nouns for male or female.

The noun 'billy' is an alternate noun for a male goat.

The alternate noun for a female goat is 'nanny'.

The noun 'Billy' (capital B) is a nickname for the name William or Bill. These names are traditionally a male name but not exclusively.