How do you get rid of little flying black bugs that seem to be in your potting soil?

Try drying it out some, if necessary replace soil. Sounds like fungus gnats from overwatering