Why some of the leaves get detached from a tree when we vigorously shakes its branch?

Either because some of the leaves are starting to die already, or because you are shaking the tree very hard.

Leaves don't fall off a tree that easily when a tree is healthy.