Embodied Decision Making on ALFWorld held-out (test)
95.5ScoreSkillOpt
Evaluation Results
| Method | Links | |
|---|---|---|
| SkillOptModel=GPT–5.5, Harness=No harness / direct chat2026.05 | 95.5 | |
| LLM skillModel=GPT–5.5, Harness=No harness / direct chat2026.05 | 93.3 | |
| Human skillModel=GPT–5.5, Harness=No harness / direct chat2026.05 | 91.8 | |
| SkillOptModel=GPT–5.4, Harness=No harness / direct chat2026.05 | 91 | |
| Trace2SkillModel=GPT–5.5, Harness=No harness / direct chat2026.05 | 87.3 | |
| GEPAModel=GPT–5.5, Harness=No harness / direct chat2026.05 | 85.8 | |
| SkillOptModel=GPT–5.4-mini, Harness=No harness / direct chat2026.05 | 85.8 | |
| SkillOptModel=GPT–5.2, Harness=No harness / direct chat2026.05 | 85.1 | |
| No skillModel=GPT–5.5, Harness=No harness / direct chat2026.05 | 83.6 | |
| LLM skillModel=GPT–5.4, Harness=No harness / direct chat2026.05 | 83.6 | |
| TextGradModel=GPT–5.5, Harness=No harness / direct chat2026.05 | 82.8 | |
| Trace2SkillModel=GPT–5.4-mini, Harness=No harness / direct chat2026.05 | 82.8 | |
| GEPAModel=GPT–5.2, Harness=No harness / direct chat2026.05 | 82.8 | |
| SkillOptModel=Qwen3.6–35B-A3B, Harness=No harness / direct chat2026.05 | 82.1 | |
| GEPAModel=GPT–5.4-mini, Harness=No harness / direct chat2026.05 | 81.3 | |
| SkillOptModel=Qwen3.5–4B, Harness=No harness / direct chat2026.05 | 81.3 | |
| TextGradModel=GPT–5.4, Harness=No harness / direct chat2026.05 | 78.4 | |
| Trace2SkillModel=GPT–5.2, Harness=No harness / direct chat2026.05 | 76.9 | |
| TextGradModel=GPT–5.2, Harness=No harness / direct chat2026.05 | 76.1 | |
| No skillModel=GPT–5.4, Harness=No harness / direct chat2026.05 | 75.4 | |
| Human skillModel=GPT–5.4, Harness=No harness / direct chat2026.05 | 74.6 | |
| GEPAModel=GPT–5.4, Harness=No harness / direct chat2026.05 | 74.6 | |
| GEPAModel=Qwen3.6–35B-A3B, Harness=No harness / direct chat2026.05 | 73.9 | |
| Trace2SkillModel=GPT–5.4, Harness=No harness / direct chat2026.05 | 73.1 | |
| No skillModel=GPT–5.4-mini, Harness=No harness / direct chat2026.05 | 73.1 | |
| TextGradModel=GPT–5.4-mini, Harness=No harness / direct chat2026.05 | 70.9 | |
| Trace2SkillModel=Qwen3.6–35B-A3B, Harness=No harness / direct chat2026.05 | 70.9 | |
| SkillOptModel=GPT–5.4-nano, Harness=No harness / direct chat2026.05 | 69.4 | |
| GEPAModel=GPT–5.4-nano, Harness=No harness / direct chat2026.05 | 68.7 | |
| No skillModel=GPT–5.2, Harness=No harness / direct chat2026.05 | 68.7 | |
| LLM skillModel=GPT–5.2, Harness=No harness / direct chat2026.05 | 68.7 | |
| TextGradModel=Qwen3.6–35B-A3B, Harness=No harness / direct chat2026.05 | 67.9 | |
| LLM skillModel=GPT–5.4-mini, Harness=No harness / direct chat2026.05 | 65.7 | |
| LLM skillModel=GPT–5.4-nano, Harness=No harness / direct chat2026.05 | 65.7 | |
| Trace2SkillModel=Qwen3.5–4B, Harness=No harness / direct chat2026.05 | 64.9 | |
| GEPAModel=Qwen3.5–4B, Harness=No harness / direct chat2026.05 | 60.4 | |
| LLM skillModel=Qwen3.6–35B-A3B, Harness=No harness / direct chat2026.05 | 60.4 | |
| No skillModel=Qwen3.6–35B-A3B, Harness=No harness / direct chat2026.05 | 59.7 | |
| Trace2SkillModel=GPT–5.4-nano, Harness=No harness / direct chat2026.05 | 58.2 | |
| Human skillModel=GPT–5.4-mini, Harness=No harness / direct chat2026.05 | 56.7 | |
| Human skillModel=GPT–5.2, Harness=No harness / direct chat2026.05 | 56.7 | |
| LLM skillModel=Qwen3.5–4B, Harness=No harness / direct chat2026.05 | 55.2 | |
| TextGradModel=Qwen3.5–4B, Harness=No harness / direct chat2026.05 | 53.7 | |
| Human skillModel=Qwen3.6–35B-A3B, Harness=No harness / direct chat2026.05 | 44.8 | |
| TextGradModel=GPT–5.4-nano, Harness=No harness / direct chat2026.05 | 42.5 | |
| No skillModel=GPT–5.4-nano, Harness=No harness / direct chat2026.05 | 34.3 | |
| No skillModel=Qwen3.5–4B, Harness=No harness / direct chat2026.05 | 30.6 | |
| Human skillModel=GPT–5.4-nano, Harness=No harness / direct chat2026.05 | 29.9 | |
| Human skillModel=Qwen3.5–4B, Harness=No harness / direct chat2026.05 | 28.4 |