What is the function of a bypass capacitor in an amplifier?

Bypass capacitors are used to bypass (shunt) unwanted signals to the ground. A common use is in power supplies where a bypass capacitor is connected in parallel with the main filter capacitor to shunt noise and other high frequency interference to ground which the main capacitor may not be able to do.