Which simple machine would you use to pry a heavy rock from the ground?

A lever! The most simple would probably be a form of lever, and this may also depend on the actual size of the "heavy rock".