Would a duke be masculine or feminine?

In English there are no masculine or feminine forms. English uses gender specific nouns for male or female.

The noun 'duke' is a gender specific noun for a male.

The corresponding gender specific noun for a female with equivalent rank is duchess.