Is yes of course a fragment?

Yes, "yes of course" is considered a sentence fragment. It lacks a subject and a verb, which are necessary components for a complete sentence. While it can convey agreement or affirmation in conversation, it doesn't stand alone as a fully formed sentence in formal writing.