Can I go get my birth certificate from the nearest Health department in GA?

Your birth record is available by contacting the Florida Department of Health Bureau of Vital Statistics, P.O. Box 210, 1217 Pearl Street, Jacksonville, FL 32231-0042.

http://www.floridahealth.gov/certificates/certificates/birth/index.html