What is the most difficult task to becoming a good driver?

For passing the test for a driver's licence, the most difficult task is usually parallel parking.

For real world driving, the most difficult task is realizing your own limits.