Are you supposed to be naked during a massage?

No. You are never naked during a massage. The term that is used that is more appropriate is disrobed. And, you are always covered with a sheet or towel so only the parts getting massaged are uncovered.