Does exponentially mean extremely rapid increase?

Yes. The Word exponentially describes a rate of increase that is extremely quick, appearing to grow by mathematical exponents.