Backfill for above ground pool

I would think any material can be used as long as the pool wall is protected from scratching. A bigger issue is that you may be violating the building code by reducing the effective height of the pool wall. Most if not all municipalities require a 48" minimum height from the ground to the top of the pool wall to keep children from being able to climb in.