If a man has a child with a woman can he take the child away from her if not married to her?

no you can't i dont think the child always stay with the mother unless you can go to court about it.