When do you know is time to replace the alternator?

The alternator should only have to be replaced if it has either failed to provide sufficient current to keep the battery charged and the car's electrical system supplied, or it has suffered mechanical damage like a worn bearing or damaged casing. Replacement for age alone is not necessary.