Offline Reinforcement Learning on D4RL Gym walker2d medium-expert
121.2Normalized Average ReturnRORL
Evaluation Results
| Method | Links | |
|---|---|---|
| RORLImplementation Source=Ours, Ensemble Size=102022.06 | 121.2 | |
| SPQRBase algorithm=SAC-Min2024.01 | 118.2 | |
| SAC-NImplementation=Ours2021.10 | 116.7 | |
| SAC-10Implementation Source=Reproduced, Ensemble Size=102022.06 | 116.7 | |
| SAC-Min2024.01 | 116.7 | |
| EDAC-10Implementation Source=Reproduced, Ensemble Size=102022.06 | 115.4 | |
| EDACImplementation=Ours2021.10 | 114.7 | |
| EDACImplementation Source=Paper2022.06 | 114.7 | |
| EDAC2024.01 | 114.7 | |
| GTP2025.10 | 114.2 | |
| QQLDomain=Gym Locomotion, Hyperparameter Tuning=consistent2025.11 | 113.2 | |
| IQLDomain=Gym Locomotion, Hyperparameter Tuning=individually tuned2025.11 | 112.7 | |
| XQLDomain=Gym Locomotion, Hyperparameter Tuning=individually tuned2025.11 | 112.7 | |
| FQL2025.10 | 111.7 | |
| MXQLDomain=Gym Locomotion, Hyperparameter Tuning=individually tuned2025.11 | 111.2 | |
| SSCQL2025.10 | 111.1 | |
| QIPO-OT2025.10 | 110.9 | |
| CQLImplementation=Original Paper2021.10 | 110.1 | |
| PBRL2022.06 | 110.1 | |
| TD3+BCDomain=Gym Locomotion, Hyperparameter Tuning=individually tuned2025.11 | 110.1 | |
| QIPO-Diff2025.10 | 110.1 | |
| CQLImplementation=Reproduced2021.10 | 109.1 | |
| CQL2022.06 | 109.1 | |
| CQL2021.06 | 108.8 | |
| CQLDomain=Gym Locomotion, Hyperparameter Tuning=individually tuned2025.11 | 108.8 | |
| Decision Transformer2021.06 | 108.1 | |
| BCDomain=Gym Locomotion, Hyperparameter Tuning=individually tuned2025.11 | 107.5 | |
| Trajectory Transformerdiscretization=quantile2021.06 | 101.9 | |
| CQL-Min2024.01 | 98.7 | |
| Trajectory Transformerdiscretization=uniform2021.06 | 91 | |
| BCImplementation=Reproduced2021.10 | 90.1 | |
| BC2022.06 | 90.1 | |
| BC2024.01 | 90.1 | |
| BRAC2021.06 | 81.6 | |
| MBOP2021.06 | 70.2 | |
| SACImplementation=Reproduced2021.10 | 68.8 | |
| UWACImplementation=Reproduced2021.10 | 55.2 | |
| Behavior Cloning2021.06 | 36.6 | |
| REMImplementation=Reproduced2021.10 | 27.9 | |
| BRACImplementation=Reproduced2021.10 | 16 | |
| MORELImplementation=Reproduced2021.10 | 1.5 | |
| BEARImplementation=Reproduced2021.10 | 1.3 | |
| BCQImplementation=Reproduced2021.10 | -0.2 |