If a person were caught committing a crime the police would need to secure a search warrant before they could conduct a search.?

Not always. The exact rules depend on the jurisdiction, but there's generally an exception made in cases where police are in active pursuit of a fugitive that they have personally witnessed commit a crime; many courts have ruled that no warrant is needed for a police officer in "hot pursuit".