Is it the difference in the R group that makes each amino acid chemically unique?

Yes. All amino acids have the same backbone (NH3-CRH-COOH), the only variant being the identity of the R group attached to the center carbon atom.