Why did johnny and ponyboy hide out in chapter five?

Johnny stabbed Bob from the Socs because he was drowning Ponyboy so they had to hide from the cops in the abandoned church.