Is it true that the internal layer of the tissue in the heart is the epicardium?

Yes, the prefix in the Word epicardium, epi- means outer, which in this case is the outer layer of the heart.