How do small business get started?

Find a need in society that can be filled, this can be anything that people would pay money to have, be it a service or a product. Then look up SWOT analysis and do one for your idea. Financially look at programs offered by your local government, and possibilites of bank loans, etc.