Do things have to be touching each other to apply forces?

No, things do not have to be touching each other to apply forces. Forces can act at a distance through fields, such as gravitational and electromagnetic fields. These fields can exert forces on objects without physical contact.