Is didn't a finite verb

No, "didn't" is not a finite verb; it is a contraction of "did not." The finite verb in the sentence would be "did," as it shows tense and agrees with the subject.