Multi-turn agent interaction on ScienceWorld
29.5ScoreGuided-OPD
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Guided-OPDParams=4B2026.06 | 29.5 | 11.5 | 22.86 | |
| Zero-shotParams=30B-A3B2026.06 | 27.73 | 7.25 | 21.62 | |
| Vanilla OPDParams=4B2026.06 | 26.45 | 7.5 | 23.88 | |
| TCODParams=4B2026.06 | 25.86 | 9.25 | 23.36 | |
| AdaSwitchParams=4B2026.06 | 25.24 | 6.25 | 24.48 | |
| Guided-OPDParams=1.7B2026.06 | 23.24 | 5.25 | 23.84 | |
| Guided-OPDParams=0.6B2026.06 | 19.63 | 3.75 | 24.63 | |
| TCODParams=1.7B2026.06 | 19.08 | 3.25 | 25.26 | |
| AdaSwitchParams=1.7B2026.06 | 17.02 | 2.75 | 26.45 | |
| Vanilla OPDParams=1.7B2026.06 | 16.94 | 3 | 25.27 | |
| Zero-shotParams=4B2026.06 | 16.21 | 3.75 | 15.97 | |
| TCODParams=0.6B2026.06 | 15.71 | 3 | 27.48 | |
| Vanilla OPDParams=0.6B2026.06 | 10.42 | 1.5 | 26.87 | |
| AdaSwitchParams=0.6B2026.06 | 9.56 | 1.25 | 29.43 | |
| Zero-shotParams=1.7B2026.06 | 6.48 | 0.75 | 24.1 | |
| Zero-shotParams=0.6B2026.06 | 5.19 | 2.25 | 20.26 |