What make a latent failure especially troublesome?

Because it doesn't happen now but at some indeterminate time in the future, probably when proper operation is critical.

This is the whole purpose of burn-in - make the latents fail before the unit leaves the factory so they can be fixed before the user gets the units.