Which factor most determines how hot or cold something feel so when you touch it?

The factor that most determines how hot or cold something feels when you touch it is the temperature difference between the object and your skin. Heat will flow from the warmer object to the cooler object until they reach thermal equilibrium. Other factors that can influence the perception of temperature include the thermal conductivity of the materials and any insulating layers present.