Valid Action Prediction on JerichoWorld 1.0 (val test)
23.5Score (Zork1)Worldformer
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| WorldformerGranularity=Action (Act), Metric Type=F12021.06 | 23.5 | — | — | 26.52 | 25.28 | 32.89 | 31.32 | 23.66 | 22.27 | 26.12 | 25.66 | 25.54 | |
| WorldformerGranularity=Action (Act), Metric Type=EM2021.06 | 23.08 | — | — | 22.55 | 20.97 | 29.08 | 27.05 | 20.71 | 21.36 | 24.04 | 22.8 | 23.22 | |
| CALMGranularity=Action (Act), Metric Type=F12021.06 | 18.9 | — | — | 25.49 | 34.42 | 12.16 | 34.4 | 9.95 | 20.94 | 7.84 | 18.57 | 19.11 | |
| CALMGranularity=Action (Act), Metric Type=EM2021.06 | 18.67 | — | — | 11.18 | 17.37 | 10.04 | 13.77 | 11.29 | 15.49 | 10.31 | 13.13 | 13.79 | |
| Seq2SeqGranularity=Action (Act), Metric Type=F12021.06 | 17.85 | — | — | 16.88 | 21.12 | 18.23 | 25.87 | 15.13 | 20.86 | 14.86 | 22.14 | 19.44 | |
| Seq2SeqGranularity=Action (Act), Metric Type=EM2021.06 | 16.65 | — | — | 15.13 | 18.19 | 16.19 | 23.39 | 14.75 | 20.1 | 14.71 | 20.34 | 18.1 |