Who is worried about the daggers leading to the killer in Macbeth?

Both Macbeth and Lady Macbeth worry about it. She says, "Why did you bring the daggers from the place?" when Macbeth fails to leave them there. She wants them left to incriminate the guards. But Macbeth worries that they may not incriminate the guards enough, so he kills them.