Is it grammatically correct to begin a sentence with for as in for example?

Yes. Strictly speaking For example at the beginning of a sentence is what is called an "absolute," grammatically unconnected to the rest of the sentence.