How do you ask your gay friend if you can give him a massage?

There is nothing particularly "sexual" about a massage unless you purposely make it so. In light of this, you should just ask him directly. Would you like a massage?

Smile at him if you wish but do not make it sound too sexual or awkward. This may make him feels uncomfortable.