Is it gramatically correct to say Sorry for the delay on this email?

If you are apologizing for the delay in your *reply*, then no. If you are apologizing for the delay to an e-mail caused by your mail provider, then possibly yes, but it should be "sorry for the delay *to* this e-mail" or similar.