Is walking gerund in 'while walking'?

In your "fragment", walking is a participle. Think of it this way; while (doing what?) walking, and since this Word adds -ing to the end of the verb "walk", it is therefore a participle.