If you can't see mold on the bread is it safe?

I have eaten bread that tasted of mold, but did not see it on the piece I ate but found mold at the other end of the loaf.

Generally, if I don't find any mold anywhere on the bread, I figure it is OK to eat.