Algebraic Word Problems on AQuA (Accuracy)
90.16AccuracySIGMA
Evaluation results
| Method | Links | |
|---|---|---|
| SIGMABase LLM=GPT-OSS-120B, Multi-agent execution=Full, Communication-topology design=Full, Skill-based composition=Full2026.06 | 90.16 | |
| SIGMABase LLM=GPT-4o-mini, Multi-agent execution=Full, Communication-topology design=Full, Skill-based composition=Full2026.06 | 83.86 | |
| SIGMABase LLM=Qwen3-8B, Multi-agent execution=Full, Communication-topology design=Full, Skill-based composition=Full2026.06 | 83.46 | |
| CARDBase LLM=GPT-OSS-120B, Multi-agent execution=Full, Communication-topology design=Full, Skill-based composition=No2026.06 | 82.76 | |
| ARG-DesignerBase LLM=Qwen3-8B, Multi-agent execution=Full, Communication-topology design=Full, Skill-based composition=No2026.06 | 82.47 | |
| G-DesignerBase LLM=Qwen3-8B, Multi-agent execution=Full, Communication-topology design=Full, Skill-based composition=No2026.06 | 82.08 | |
| CARDBase LLM=Qwen3-8B, Multi-agent execution=Full, Communication-topology design=Full, Skill-based composition=No2026.06 | 81.92 | |
| GPTSwarmBase LLM=Qwen3-8B, Multi-agent execution=Full, Communication-topology design=Partial, Skill-based composition=No2026.06 | 81.52 | |
| LLM-DebateBase LLM=Qwen3-8B, Multi-agent execution=Full, Communication-topology design=No, Skill-based composition=No2026.06 | 81.14 | |
| CoTBase LLM=Qwen3-8B, Multi-agent execution=No, Communication-topology design=No, Skill-based composition=No2026.06 | 81.1 | |
| CARDBase LLM=GPT-4o-mini, Multi-agent execution=Full, Communication-topology design=Full, Skill-based composition=No2026.06 | 80.4 | |
| ARG-DesignerBase LLM=GPT-OSS-120B, Multi-agent execution=Full, Communication-topology design=Full, Skill-based composition=No2026.06 | 78.62 | |
| ARG-DesignerBase LLM=GPT-4o-mini, Multi-agent execution=Full, Communication-topology design=Full, Skill-based composition=No2026.06 | 78.16 | |
| G-DesignerBase LLM=GPT-OSS-120B, Multi-agent execution=Full, Communication-topology design=Full, Skill-based composition=No2026.06 | 78.13 | |
| GPTSwarmBase LLM=GPT-OSS-120B, Multi-agent execution=Full, Communication-topology design=Partial, Skill-based composition=No2026.06 | 77.41 | |
| G-DesignerBase LLM=GPT-4o-mini, Multi-agent execution=Full, Communication-topology design=Full, Skill-based composition=No2026.06 | 76.58 | |
| CoTBase LLM=GPT-OSS-120B, Multi-agent execution=No, Communication-topology design=No, Skill-based composition=No2026.06 | 76.02 | |
| LLM-DebateBase LLM=GPT-OSS-120B, Multi-agent execution=Full, Communication-topology design=No, Skill-based composition=No2026.06 | 75.38 | |
| GPTSwarmBase LLM=GPT-4o-mini, Multi-agent execution=Full, Communication-topology design=Partial, Skill-based composition=No2026.06 | 75.06 | |
| VanillaBase LLM=GPT-OSS-120B, Multi-agent execution=No, Communication-topology design=No, Skill-based composition=No2026.06 | 74.77 | |
| LLM-DebateBase LLM=GPT-4o-mini, Multi-agent execution=Full, Communication-topology design=No, Skill-based composition=No2026.06 | 72.93 | |
| CoTBase LLM=GPT-4o-mini, Multi-agent execution=No, Communication-topology design=No, Skill-based composition=No2026.06 | 71.85 | |
| VanillaBase LLM=GPT-4o-mini, Multi-agent execution=No, Communication-topology design=No, Skill-based composition=No2026.06 | 69.8 | |
| VanillaBase LLM=Qwen3-8B, Multi-agent execution=No, Communication-topology design=No, Skill-based composition=No2026.06 | 35.83 |