What is the driving potential for heat transfer?

The molecules (or atoms at a smaller level) of a substance which are on average moving faster are hotter (more heat). When these molecules come in contact with another substance with slower molecules they impact each other (either physically or through forces) and transfer some of their speed (kinetic energy) to the slower molecules. Thus the temperature decreases in the first substance and increases in the second substance.