How do you get the rust off your electric razor?

Get a new razor. It's not worth the time, effort, and money to clean rust off of a razor. Assuming you can actually get the rust mostly off of the razor, you're still opening yourself up to things like tetanus should you ever cut yourself.