If the baffling is broken is the exhaust is it bad for the motor?

It is not bad for the motor, it might make it sound obnoxious and you might lose some low end torque. The engine uses some of the exhaust to build back pressure used in making lower end torque. the kind you use in most everyday non-highway driving. It also depends on if you are talking about a 4 cylinder or a v-8