What is causing the whining noise when you start your golf gti mk4?

It is your starter. It's not going out. Just a manufacturing flaw. Mine does the same.

No need to worry.