Why did the five drive into the city on such a hot afternoon?

Because Daisy wants to avoid confrontation and get away from her problems. She did not want to stay home and fight with Tom because she knew that he found out about her "affair" with Gatsby.