What is the plural form of dismay?

There is no plural form for the noun dismay. Dismay is a state of being, you are either in that state or you are not. When you need to say that a number of people are in the state of dismay, you use the adjective form, the dismayed people, or the verb form, they were dismayed.