Achievement Success Rate on Craftax-Classic single 64 x 64 overworld
91.7Eat Plant Success RateSCALAR
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SCALARBackbone=FC, Frontier Checkpointing=true, Trajectory Analysis=true, Training frames=1B, Seeds=52026.03 | 91.7 | 88.2 | |
| SCALAR (w/o Frontier Checkpointing)Frontier Checkpointing=false, Trajectory Analysis=true, Training frames=1B, Seeds=52026.03 | 90.7 | 88.2 | |
| PQN-RNNBackbone=RNN, Training frames=1B, Seeds=52026.03 | 55.3 | 46.9 | |
| PPO-FCBackbone=FC, Training frames=1B, Seeds=52026.03 | 23.9 | 35.4 | |
| PPO-RNDExploration bonus=RND, Training frames=1B, Seeds=52026.03 | 21.9 | 34.5 | |
| PQNTraining frames=1B, Seeds=52026.03 | 19 | 0 | |
| PPO-RNNBackbone=RNN, Training frames=1B, Seeds=52026.03 | 0 | 40.9 | |
| PPO-TRXLBackbone=TRXL, Training frames=1B, Seeds=52026.03 | 0 | 31.5 | |
| SCALAR (w/o Frontier Checkpointing, w/o Trajectory Analysis)Frontier Checkpointing=false, Trajectory Analysis=false, Training frames=1B, Seeds=52026.03 | 0 | 67.3 | |
| SCALAR-TRXLBackbone=TRXL, Frontier Checkpointing=false, Training frames=1B, Seeds=52026.03 | 0 | 45 |