Is walking past tense or present tense?

Walking is a present participle. Present participles can be used to create the progressive (continuous) tenses. They rely on auxiliary verbs to show the tense.

Examples:

Am/Is/Are walking (present progressive)

Was/Were walking (past progressive)

Will be walking (future progressive)