What does it mean to remember the planter when you eat the fruit?

It appears to be a cautionary phrase telling you to be careful what you accept and from whom, and probably can be taken to include any offers that might or might not be scrupulous.