Where did Jem receive most if his information about Boo Radley?

On the night in question, Jem's pants get stuck on Boo Radley's fence and he is forced to leave them behind. Jem later tells Scout that when he went back to retrieve them, the pants were sewn and nicely folded and waiting for him on the fence.