Why do you need a bureaucracy?

If run efficiently and mostly uncorrupted, it allows the government to achieve it's goals and enact policies much faster. Bureaucracies spread the workload of governing a people (Who tend to unruly the more there are) over many people to ease the burden.