Why did Jonas and The Giver think a society exists outside the community?

They believed another society existed because the Giver had memories of things that didn't exist in the community where he and Jonas lived. The Giver was able to share with Jonas memories of colors like red that weren't present in the community, and memories of love and family, which was a social construct that didn't exist in the community either.