How fast does the rotation of a tornado have to be to damage a house?

If it's enough to be classified as a tornado, it will damage your house. Generally, winds in excess of 60 mph are considered sufficient to cause visible damage, though at this point it will be superficial unless a tree falls on ths house.