Aspen shavings.
If you can't find them anywhere, you can use coarse pine shavings. Avoid fine pine (can be easily inhaled or ingested).
Never use cedar (it is toxic).
You would line the box a few inches with this, and then offer some paper or other safe bits to shred and they can build on their nest if they want to.