Do you put a comma inside a quotation mark on song titles when there is more than one in a sentence?

Yes, in American English, commas always go inside quotation marks, regardless of how many titles are in the sentence. For example: "I listened to 'Shape of You,' 'Despacito,' and 'Havana' on the radio yesterday."