Transformers for Sequential Decision Making Reading List

Curated by Mouhssine Rifaki | Stanford Electrical Engineering | Last updated April 2026

Applying attention mechanisms and sequence models to reinforcement learning and control.

1. Decision Transformer: Reinforcement Learning via Sequence Modeling
   Chen et al.. NeurIPS 2021.
2. Offline Reinforcement Learning as One Big Sequence Modeling Problem
   Janner et al.. NeurIPS 2021.
3. Online Decision Transformer
   Zheng et al.. ICML 2022.
4. A Generalist Agent
   Reed et al.. arXiv 2022.
5. Multi-Game Decision Transformers
   Lee et al.. NeurIPS 2022.
6. Attention Is All You Need
   Vaswani et al.. NeurIPS 2017.
7. Stabilizing Transformers for Reinforcement Learning
   Parisotto et al.. ICML 2020.
8. In-context Reinforcement Learning with Algorithm Distillation
   Laskin et al.. ICLR 2023.
9. Hyena Hierarchy: Towards Larger Convolutional Language Models
   Poli et al.. ICML 2023.