What is the reason for having a combustion chamber on a rocket?

A combustion chamber is where combustion occurs in a controlled fashion. Because the basic idea of a rocket is burning fuels and directing them in the opposite direction to that of travel, a controlled burning - as happens in the combustion chamber - is exactly what a rocket needs to work.