Unsupervised Environment Design Reading List

Curated by Mouhssine Rifaki | Stanford Electrical Engineering | Last updated April 2026

Automatically generating training environments to improve agent robustness and generalization.

1. Prioritized Level Replay
   Jiang et al.. ICML 2021.
2. Evolving Curricula with Regret-Based Environment Design
   Parker-Holder et al.. ICML 2022.
3. Replay-Guided Adversarial Environment Design
   Jiang et al.. NeurIPS 2021.
4. Emergent Complexity and Zero-Shot Transfer via Unsupervised Environment Design
   Dennis et al.. NeurIPS 2021.
5. Dual Curriculum Design
   Jiang et al.. NeurIPS 2022.
6. Generating Automatic Curricula via Self-Supervised Active Domain Randomization
   Mehta et al.. ICRA 2020.
7. Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Their Solutions
   Wang et al.. arXiv 2019.
8. Robust Reinforcement Learning via Adversarial Training with Langevin Dynamics
   Kamalaruban et al.. NeurIPS 2020.
9. Curriculum Learning for Reinforcement Learning Domains: A Framework and Survey
   Narvekar et al.. JMLR 2020.