What was neglected while Jack and his hunters were out killing the pig in 'Lord of the Flies'?

When searching for the beast the boys get distracted by the rock formation, "Castle Rock", that could be a fort for them