What is the origin for handle with kit gloves?

The phrase "handled with kid gloves" means to handle something very delicately. In the 19th century, single person wore kid gloves was a euphemism for daintiness or an aversion to work.