Will an external leak in the manifold hurt your engine?

Any leak will change the way the engine breathes. Any change can change the air/fuel mixture. If it changes enough it can cause damage.