Is it possible to hatch a female combee from an egg?

Yes, but the possibilities of getting a female is tiny. Most likely you'll get a male combee. Only female combees can evolve into vespiquen.