Online Fine-tuning on D4RL MuJoCo and Maze2D (v2 v0)
98Normalized ReturnCal-QL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Cal-QLReward Signal=Step-wise Reward, Fine-tuning stages=32025.12 | 98 | 40 | |
| ODTReward Signal=Step-wise Reward, Fine-tuning stages=32025.12 | 97.5 | 30.6 | |
| GACReward Signal=Final Return, Fine-tuning stages=32025.12 | 93.3 | 33.1 | |
| PPOReward Signal=Step-wise Reward, Fine-tuning stages=32025.12 | 77.8 | — | |
| SACReward Signal=Step-wise Reward, Fine-tuning stages=32025.12 | 75 | — | |
| IQLReward Signal=Step-wise Reward, Fine-tuning stages=32025.12 | 66.8 | 3 | |
| LPTReward Signal=Final Return, Fine-tuning stages=32025.12 | 64.8 | 6.3 | |
| CQLReward Signal=Step-wise Reward, Fine-tuning stages=32025.12 | 60.4 | 2.4 | |
| ODTReward Signal=Final Return, Fine-tuning stages=32025.12 | 57.6 | 0.3 | |
| Cal-QLReward Signal=Final Return, Fine-tuning stages=32025.12 | 32.8 | 9.5 | |
| CQLReward Signal=Final Return, Fine-tuning stages=32025.12 | 29.6 | 6.3 | |
| IQLReward Signal=Final Return, Fine-tuning stages=32025.12 | 25 | -10.1 | |
| PPOReward Signal=Final Return, Fine-tuning stages=32025.12 | 13.1 | — | |
| SACReward Signal=Final Return, Fine-tuning stages=32025.12 | 11.2 | — |