Will a starter make a whining noise when it is bad?

Yep, a starter can whine worse than a little kid.

If the "bendix" doesn't kick the gear out to fully engage into the flywheel teeth - and even worse: if the teeth on the flywheel are worn down/away.

A physical inspection of the starter and flywheel gear-teeth will be a good guide.