How many presidents held public office after their retirements as president?

John Quincy Adams was elected to a house seat and Andrew Johnson to the Senate after they left the presidency. Taft was appointed to the Supreme Court.