Science Experimentation Reasoning on ScienceWorld (seen)
89.7Success RateSKILLPYRAMID
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SKILLPYRAMIDModel=Gemini 2.5 Pro2026.06 | 89.7 | 9 | |
| SKILLPYRAMIDModel=GPT-4.12026.06 | 86.6 | 15.2 | |
| SKILLPYRAMIDModel=Qwen3-235B2026.06 | 85.6 | 14 | |
| ReAct + SkillsModel=GPT-4.12026.06 | 78.6 | 17.6 | |
| SkillRerankerBackbone Model=DeepSeek-v4-Flash2026.07 | 78.46 | 15.77 | |
| ReAct + SkillsModel=Gemini 2.5 Pro2026.06 | 77.3 | 16.7 | |
| SKILLPYRAMIDModel=DeepSeek-V3.22026.06 | 76.3 | 16.7 | |
| SkillRouterBackbone Model=DeepSeek-v4-Flash2026.07 | 75.28 | 16.61 | |
| ExpeLModel=DeepSeek-V3.22026.06 | 74.9 | 16 | |
| ReAct + SkillsModel=Qwen3-235B2026.06 | 74.2 | 15.5 | |
| SkillRerankerBackbone Model=GPT-5.4-Mini2026.07 | 73.61 | 14.48 | |
| Graph of SkillsBackbone Model=DeepSeek-v4-Flash2026.07 | 73.32 | 18.12 | |
| LLM-as-selectorBackbone Model=DeepSeek-v4-Flash2026.07 | 73.06 | 17.11 | |
| SkillRouterBackbone Model=GPT-5.4-Mini2026.07 | 73.06 | 14.71 | |
| SkillRouterBackbone Model=Qwen3.6-27B2026.07 | 72.85 | 12.15 | |
| ExpeLModel=Gemini 2.5 Pro2026.06 | 72.8 | 15 | |
| ReflexionModel=DeepSeek-V3.22026.06 | 72.4 | 16.3 | |
| SkillRerankerBackbone Model=Qwen3.6-27B2026.07 | 72.26 | 11.26 | |
| ExpeLModel=GPT-4.12026.06 | 72.1 | 14.4 | |
| ReAct + SkillsModel=DeepSeek-V3.22026.06 | 71.6 | 15.9 | |
| ReActModel=DeepSeek-V3.22026.06 | 69.9 | 17.6 | |
| ExpeLModel=Qwen3-235B2026.06 | 69.4 | 15.3 | |
| LLM-as-selectorBackbone Model=Qwen3.6-27B2026.07 | 68.45 | 11.95 | |
| Graph of SkillsBackbone Model=Qwen3.6-27B2026.07 | 67.4 | 12.42 | |
| ReflexionModel=GPT-4.12026.06 | 66.8 | 17 | |
| ReflexionModel=Gemini 2.5 Pro2026.06 | 66.8 | 16.9 | |
| LLM-as-selectorBackbone Model=GPT-5.4-Mini2026.07 | 66.54 | 15.59 | |
| Graph of SkillsBackbone Model=GPT-5.4-Mini2026.07 | 63.61 | 16.22 | |
| ReflexionModel=Qwen3-235B2026.06 | 63.6 | 17.7 | |
| ReActModel=Gemini 2.5 Pro2026.06 | 58.2 | 18.4 | |
| ReActModel=GPT-4.12026.06 | 57.4 | 19.1 | |
| ReActModel=Qwen3-235B2026.06 | 54.8 | 19.6 |