Where is the Pied Piper lose the children?

The Pied Piper took the children from the village and had them follow him since the parents never paid his fee. It doesn't ever say where he lost them, just that they followed him.