Is the exhaust part of the engine?

No, not really. An engine will run without an exhaust (but you may get arrested).

The exhaust simply directs waste gasses and quietens the noise. It plays no part in the running of the engine, but can reduce the performance if it causes on obstruction to the gasses.