How can you remove an organism growing in the pool that looks like black spots of fine dirt but will vacuum or brush off?

You have mustard algae. Have your local pool store test for phosphates. I can almost guarantee you have them. This makes you a candidate for mustard algae. You should try a product that removes phosphates. LoChlor's Algaecide and Starver Treatment is the best.