Where are there free diamonds?

You can dig for diamonds in Arkansas' state park: Crater of Diamonds, and keep any diamond that you find.

There may be an admission fee to the state park, and you would be required to either rent or purchase that tools you choose to use there.