Is backing the most dangerous maneuver in driving?

Yes

There is a 100% true saying in the bus driver profession.

95% of bus drivers will loose their job in reverse.

If you think about it:

You can't see very well when Backing

Pedestrians and other cars are flat out stupid as they think that when they have the "Right of Way" you won't run over them.