Are cliffs formed by erosion

They can be, such as where a stream or river cuts into the ground, forming a gorge or canyon.

However, cliffs may also be formed by uplift from tectonic forces.