Science Experimentation Reasoning on ScienceWorld (unseen)
88.6Success RateSKILLPYRAMID
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SKILLPYRAMIDModel=GPT-4.12026.06 | 88.6 | 14.2 | |
| SKILLPYRAMIDModel=Qwen3-235B2026.06 | 86.3 | 14.3 | |
| SKILLPYRAMIDModel=Gemini 2.5 Pro2026.06 | 82.9 | 14.3 | |
| SKILLPYRAMIDModel=DeepSeek-V3.22026.06 | 79.1 | 17 | |
| ReAct + SkillsModel=Gemini 2.5 Pro2026.06 | 79.1 | 17 | |
| SkillRerankerBackbone Model=DeepSeek-v4-Flash2026.07 | 74.41 | 16.84 | |
| ExpeLModel=DeepSeek-V3.22026.06 | 74.1 | 17.5 | |
| ReAct + SkillsModel=Qwen3-235B2026.06 | 73 | 15.9 | |
| SkillRouterBackbone Model=DeepSeek-v4-Flash2026.07 | 72.85 | 18.14 | |
| LLM-as-selectorBackbone Model=DeepSeek-v4-Flash2026.07 | 71.95 | 19.59 | |
| ReAct + SkillsModel=GPT-4.12026.06 | 71.8 | 18.6 | |
| Graph of SkillsBackbone Model=DeepSeek-v4-Flash2026.07 | 70.68 | 18.77 | |
| SkillRerankerBackbone Model=GPT-5.4-Mini2026.07 | 69.64 | 15.6 | |
| ReAct + SkillsModel=DeepSeek-V3.22026.06 | 68.5 | 16.6 | |
| ReflexionModel=DeepSeek-V3.22026.06 | 67.8 | 17.9 | |
| SkillRerankerBackbone Model=Qwen3.6-27B2026.07 | 67.73 | 13.08 | |
| ExpeLModel=Gemini 2.5 Pro2026.06 | 67.4 | 14.9 | |
| SkillRouterBackbone Model=GPT-5.4-Mini2026.07 | 66.97 | 16.22 | |
| SkillRouterBackbone Model=Qwen3.6-27B2026.07 | 66.82 | 12.88 | |
| ExpeLModel=GPT-4.12026.06 | 66.8 | 15.6 | |
| LLM-as-selectorBackbone Model=Qwen3.6-27B2026.07 | 66.24 | 13.19 | |
| LLM-as-selectorBackbone Model=GPT-5.4-Mini2026.07 | 64.72 | 17.18 | |
| ReActModel=DeepSeek-V3.22026.06 | 64.7 | 19.3 | |
| ExpeLModel=Qwen3-235B2026.06 | 63.8 | 16.2 | |
| Graph of SkillsBackbone Model=GPT-5.4-Mini2026.07 | 63.41 | 17.23 | |
| ReflexionModel=Gemini 2.5 Pro2026.06 | 63.2 | 17.5 | |
| ReflexionModel=GPT-4.12026.06 | 61.6 | 18.2 | |
| Graph of SkillsBackbone Model=Qwen3.6-27B2026.07 | 61.06 | 13.17 | |
| ReflexionModel=Qwen3-235B2026.06 | 59.4 | 18.9 | |
| ReActModel=Gemini 2.5 Pro2026.06 | 56.1 | 19.1 | |
| ReActModel=GPT-4.12026.06 | 52.3 | 20.2 | |
| ReActModel=Qwen3-235B2026.06 | 50.6 | 20.8 |