Who are antagonists in flowers for algernon?

One is Charlie's intelligence because he makes him lose his job, and some people can't understand him (because he's so smart). Another antagonist is one of the doctors because he is against Charlie doing the procedure.