What made the Holy Roman Empire holy?

The term "Holy" was used by emperor Frederick Barbarossa in the 12th century as a response to the pope who technically called the emperor one of his vassals. The emperor on the other hand felt himself as highest sovereign on earth.