Why do the swimmers have to bounce off of the wall?

They don't have to, but having them all touch the wall is an easy rule to make them all swim the same length. Also, using the wall to push against gets them back to speed a lot faster than if they'd turn just in free water.