Why does furnace go off and on?

There is probably a thermostatic control somewhere that shuts it down when some temperature limit is reached, and on again when the temperature gets too low. Alternatively there might be a fault which shows up when the furnace gets too hot.