What are the pros and cons of paying bills online?

Many of the pros relate to having all your billing information in one place resulting in less stress as well as a way to avoid penalties and late fees. One of the few cons relates to security.