Which parents determine the sex of a baby?

The father's genetic contribution determines the sex of the baby. Women have XX chromosomes, men have XY (this is part of the definition of female and male). The male provides either X or Y to the woman's X. So if the man donates an X, the baby is XX and thus female. If he donates a Y, the baby is XY and thus male.