Offline Reinforcement Learning on D4RL Gym hopper-medium-expert
112.7Normalized Avg ReturnRORL
Evaluation Results
| Method | Links | |
|---|---|---|
| RORLImplementation Source=Ours, Ensemble Size=102022.06 | 112.7 | |
| SPQRBase algorithm=SAC-Min2024.01 | 112.5 | |
| QQLDomain=Gym Locomotion, Hyperparameter Tuning=consistent2025.11 | 112.5 | |
| GTP2025.10 | 112.2 | |
| QIPO-Diff2025.10 | 112.1 | |
| SPQRBase algorithm=EDAC2024.01 | 111.7 | |
| ROMI-CQLbase algorithm=CQL2021.10 | 111.4 | |
| XQLDomain=Gym Locomotion, Hyperparameter Tuning=individually tuned2025.11 | 111.2 | |
| COMBOalgorithm class=model-based2021.10 | 111.1 | |
| CQLImplementation=Original Paper2021.10 | 111 | |
| CQL-Min2024.01 | 111 | |
| SSCQL2025.10 | 110.9 | |
| PBRL2022.06 | 110.8 | |
| EDACImplementation=Ours2021.10 | 110.7 | |
| EDACImplementation Source=Paper2022.06 | 110.7 | |
| EDAC2024.01 | 110.7 | |
| MXQLDomain=Gym Locomotion, Hyperparameter Tuning=individually tuned2025.11 | 110.7 | |
| SAC-NImplementation=Ours2021.10 | 110.1 | |
| SAC-Min2024.01 | 110.1 | |
| QIPO-OT2025.10 | 108 | |
| BCQImplementation=Reproduced2021.10 | 106.9 | |
| CQLalgorithm class=model-free2021.10 | 106.8 | |
| CQLDomain=Gym Locomotion, Hyperparameter Tuning=individually tuned2025.11 | 105.4 | |
| FQL2025.10 | 104.6 | |
| TD3+BCDomain=Gym Locomotion, Hyperparameter Tuning=individually tuned2025.11 | 98 | |
| CQLImplementation=Reproduced2021.10 | 96.9 | |
| CQL2022.06 | 96.9 | |
| IQLDomain=Gym Locomotion, Hyperparameter Tuning=individually tuned2025.11 | 91.5 | |
| BEARImplementation=Reproduced2021.10 | 66.2 | |
| EDAC-10Implementation Source=Reproduced, Ensemble Size=102022.06 | 58.1 | |
| BCImplementation=Reproduced2021.10 | 53.9 | |
| BC2022.06 | 53.9 | |
| BC2024.01 | 53.9 | |
| BCDomain=Gym Locomotion, Hyperparameter Tuning=individually tuned2025.11 | 52.5 | |
| UWACImplementation=Reproduced2021.10 | 48.6 | |
| MORELImplementation=Reproduced2021.10 | 46.2 | |
| BC2021.10 | 36 | |
| BRACImplementation=Reproduced2021.10 | 16.6 | |
| SAC-10Implementation Source=Reproduced, Ensemble Size=102022.06 | 6.1 | |
| REMImplementation=Reproduced2021.10 | 0.8 | |
| SACImplementation=Reproduced2021.10 | 0.7 |