Why a capacitor of higher value is preferable?

It can hold a very large amount of charge and release the same over along period of time.

It depends in what circuit you are using it.

For power supply decoupling and regulation, bigger is better.

If you change the capactior value in a timing or tuned circuit, it will not behave as designed.