Are all paper towels made of cotton?

No, paper towels are made of paper, which is wood and plant fiber pulp. Cotton is a natural fiber. Both are mostly cellulose, but cotton is generally not used in paper towels.