Can a father take away daughter baby away even though he wasn't in her life?

In the USA it is pretty much impossible to legally take a baby away from a woman unless you prove to a court that she cannot care for the baby.