How would this person know Jem well enough to anticipate his returning to claiim the pants?

The person may have a close relationship with Jem where they understand his habits and routines well. By knowing Jem's thought process and behaviors, the person could predict that he would return for the pants, especially if they hold sentimental value or if Jem has a pattern of revisiting particular places.