Is this sentence grammatically correct- give up for never?

Yes, but it is still wrong. Grammatically correct is not the same as meaningful. Assuming you mean "yield for all time," use "give up for ever" instead of "...for never."