Do all babies begin as female?

Yes, in the very beginning of your life everyone was a female. However within the first few weeks the sex is determined and then the males become males.