What memory did the giver give to the committee about increasing the population?

Starvation. If the number of births increased, the supply of food would decrease.