How did the restoration of voting rights to white southerns undermine efforts to preserve and protect the voting rights of freedmen?

When they gave rights back to the white, blacks were again segregated because they were iliterate and the whites could over vote them.