A curated list of Decision Transformer resources (continually updated)
This is a collection of research papers for Decision Transformer (DT). And the repository will be continuously updated to track the frontier of DT.
Welcome to follow and star!
The Decision Transformer was proposed by “Decision Transformer: Reinforcement Learning via Sequence Modeling” by Chen L. et al. It casts (offline) Reinforcement Learning as a conditional-sequence modeling problem.
Specifically, DT model is a causal transformer model conditioned on the desired return, (past) states, and actions to generate future actions in an autoregressive manner.
format:
- [title](paper link) [links]
- author1, author2, and author3...
- publisher
- key
- code
- experiment environment
Context-Former: Stitching via Latent Conditioned Sequence Modeling
Real-time Network Intrusion Detection via Decision Transformers
Rethinking Decision Transformer via Hierarchical Reinforcement Learning
Prompt-Tuning Decision Transformer with Preference Ranking
A Survey on Transformers in Reinforcement Learning
Can Offline Reinforcement Learning Help Natural Language Understanding?
PACT: Perception-Action Causal Transformer for Autoregressive Robotics Pre-Training
LATTE: LAnguage Trajectory TransformEr
Offline Pre-trained Multi-Agent Decision Transformer: One Big Sequence Model Tackles All SMAC Tasks
Transfer learning with causal counterfactual reasoning in Decision Transformers
Pretraining for Language Conditioned Imitation with Transformers
An Offline Deep Reinforcement Learning for Maintenance Decision-Making
A Sequence Modelling Approach to Question Answering in Text-Based Games
Deep Transformer Q-Networks for Partially Observable Reinforcement Learning
Multi-Agent Reinforcement Learning is a Sequence Modeling Problem
Transformers are Adaptable Task Planners
You Can't Count on Luck: Why Decision Transformers Fail in Stochastic Environments
When does return-conditioned supervised learning work for offline reinforcement learning?
SimStu-Transformer: A Transformer-Based Approach to Simulating Student Behaviour
Attention-Based Learning for Combinatorial Optimization
Decision ConvFormer: Local Filtering in MetaFormer is Sufficient for Decision Making
When should we prefer Decision Transformers for Offline Reinforcement Learning?
Searching for High-Value Molecules Using Reinforcement Learning and Transformers
EDGI: Equivariant Diffusion for Planning with Embodied Agents
Offline Reinforcement Learning for Customizable Visual Navigation
Instruction-driven history-aware policies for robotic manipulations
Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulation
Prompting Decision Transformer for Few-Shot Policy Generalization
Addressing Optimism Bias in Sequence Modeling for Reinforcement Learning
AnyMorph: Learning Transferable Polices By Inferring Agent Morphology
Learning Transferable Policies By Inferring Agent Morphology
Generalized Decision Transformer for Offline Hindsight Information Matching
Decision Transformer: Reinforcement Learning via Sequence Modeling
Offline Reinforcement Learning as One Big Sequence Modeling Problem
TransDreamer: Reinforcement Learning with Transformer World Models
Our purpose is to make this repo even better. If you are interested in contributing, please refer to HERE for instructions in contribution.
Awesome Decision Transformer is released under the Apache 2.0 license.