Can you clean baby rabbits nest area?

Yes, but normally this is something the doe does for herself until the babies are 10 days to 2 weeks old. By that time babies should be jumping out of box to go potty. If you do clean nest box be sure you save some of the fur (as much as possible) to put back into the clean nest.