Multi-hop Question Answering on HotpotQA (Avg@8 accuracy)
92.52Avg@8 AccuracyST-EVO
Evaluation Results
| Method | Links | |
|---|---|---|
| ST-EVOBackbone=gpt-oss-120b2026.02 | 92.52 | |
| AFlowBackbone=gpt-oss-120b2026.02 | 90.04 | |
| STEERBackbone=gpt-oss-120b2026.02 | 89.35 | |
| SpecReasonBackbone=gpt-oss-120b2026.02 | 88.29 | |
| G-DesignerBackbone=gpt-oss-120b2026.02 | 87.66 | |
| SafeSieveBackbone=gpt-oss-120b2026.02 | 87.22 | |
| ARG-DesignerBackbone=gpt-oss-120b2026.02 | 86.45 | |
| GPTSwarmBackbone=gpt-oss-120b2026.02 | 85.4 | |
| LangGraphBackbone=gpt-oss-120b2026.02 | 84.92 | |
| LLM-DebateBackbone=gpt-oss-120b2026.02 | 84.55 | |
| Random GraphBackbone=gpt-oss-120b2026.02 | 84.28 | |
| StarBackbone=gpt-oss-120b2026.02 | 83.52 | |
| Complete GraphBackbone=gpt-oss-120b2026.02 | 83.35 | |
| AutoGenBackbone=gpt-oss-120b2026.02 | 83.25 | |
| VanillaBackbone=gpt-oss-120b2026.02 | 82.35 | |
| SCBackbone=gpt-oss-120b2026.02 | 82.24 | |
| TreeBackbone=gpt-oss-120b2026.02 | 81.5 | |
| CoTBackbone=gpt-oss-120b2026.02 | 81.04 | |
| ChainBackbone=gpt-oss-120b2026.02 | 80.77 | |
| ADOPT-JointPrompt Optimization Strategy=ADOPT-Joint2025.12 | 68 | |
| ADOPT-InstructPrompt Optimization Strategy=ADOPT-Instruct2025.12 | 67 | |
| GEPAPrompt Optimization Strategy=GEPA2025.12 | 63 | |
| MIPROPrompt Optimization Strategy=MIPRO2025.12 | 62 | |
| COTPrompt Optimization Strategy=Chain-of-Thought2025.12 | 58 | |
| No-COTPrompt Optimization Strategy=No-COT2025.12 | 52 | |
| MAS-OrchestraOrchestration Type=Training-time Orchestration, Orchestrator LLM=Qwen-7b, Sub-agent Backbone=GPT-120b (low)2026.01 | 49 | |
| SearchAgentOrchestration Type=Standalone Agent, Sub-agent Backbone=GPT-120b (low)2026.01 | 46.44 | |
| ToolOrchestraOrchestration Type=Public Training-time Orchestration, Sub-agent Backbone=GPT-120b (low)2026.01 | 37.44 | |
| DebateAgentOrchestration Type=Standalone Agent, Sub-agent Backbone=GPT-120b (low)2026.01 | 36.88 | |
| ReflexionAgentOrchestration Type=Standalone Agent, Sub-agent Backbone=GPT-120b (low)2026.01 | 36.63 | |
| SCAgentOrchestration Type=Standalone Agent, Sub-agent Backbone=GPT-120b (low)2026.01 | 35.5 | |
| CoTAgentOrchestration Type=Standalone Agent, Sub-agent Backbone=GPT-120b (low)2026.01 | 33.56 |