What is causing ancient buildings and structures to erode and decay?

Roots from Trees or other plants growing under the building and tilting it which is breaking off all of the loose pieces.