Is I didn't know that. a sentence fragment?

Yes, "I didn't know that" is a complete sentence, not a fragment. It contains a subject ("I") and a predicate ("didn't know that"), expressing a complete thought. A sentence fragment typically lacks one of these elements or does not convey a full idea.