Do you clean out a bluebirds nest once they have gone?

Yes, you can. They will start over and make a new nest. If you leave it in they will put new materials over the old nest to make it fresh.