Who does using cell phones while driving affect?

Yes if your not responsible..

If you drive while talking on the phone, your reaction times are seriously impaired.

ADDED: it's actually illegal in the UK, and I think in other countries, certainly to use hand-held phones. I think you can use hands-free sets but it's a rather grey area and you could still be held to be not in full control of the vehicle.