Is an exclamation point inside quotation marks followed by a comma?

No, because putting a comma signifies that the sentence ends outside the quotation marks and putting an exclamation mark says that it ends inside.