Why the gun leans backward when the bullet fire from the gun?

It's the recoil from the force of the bullet being fired. The gun powder pushes the bullet forward and also equally pushes the gun back into your hand.