What can be done about a ceiling fan that emits an oily smell?

Replace it. This could be the shellac on the windings of the motor you're smelling because its getting hot. If it is definitely running cool then its probably the bearings losing some grease which is getting on the windings.