Achievement Success Rate on Craftax procedurally generated 9 floors
96.5Enter Dungeon Success RatePPO-TRXL
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| PPO-TRXLBackbone=TRXL, Training frames=1B, Seeds=52026.03 | 96.5 | 0.4 | 0 | |
| PQN-RNNBackbone=RNN, Training frames=1B, Seeds=52026.03 | 92.5 | 0 | 0 | |
| PPO-RNNBackbone=RNN, Training frames=1B, Seeds=52026.03 | 89.7 | 0 | 0 | |
| PPO-RNDExploration bonus=RND, Training frames=1B, Seeds=52026.03 | 87.4 | 1.9 | 0 | |
| PPO-FCBackbone=FC, Training frames=1B, Seeds=52026.03 | 86.6 | 1.8 | 0 | |
| SCALAR-TRXLBackbone=TRXL, Frontier Checkpointing=false, Training frames=1B, Seeds=52026.03 | 85.2 | 34.1 | 8.2 | |
| PQNTraining frames=1B, Seeds=52026.03 | 77.4 | 0.8 | 0 | |
| SCALAR (w/o Frontier Checkpointing)Frontier Checkpointing=false, Trajectory Analysis=true, Training frames=1B, Seeds=52026.03 | 58.9 | 11.5 | 1.3 | |
| SCALARBackbone=FC, Frontier Checkpointing=true, Trajectory Analysis=true, Training frames=1B, Seeds=52026.03 | 58.4 | 35 | 9.1 | |
| SCALAR (w/o Frontier Checkpointing, w/o Trajectory Analysis)Frontier Checkpointing=false, Trajectory Analysis=false, Training frames=1B, Seeds=52026.03 | 22.9 | 0.4 | 0 |