What are the remains of living things that have been preserved in earth crust?

Fossils, although technically they are not preserved in the earths crust; the minerals in the bones and pore spaces have been replaced by other harder minerals which take much longer to weather.

There are a number of different fossilization processes. See this link :
How are Fossils Formed?