Multi-Agent Reasoning on GPQA
198CallsCoTAgent
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| CoTAgent2026.01 | 198 | 0.16 | 0.06 | 1.18 | |
| MAS-Orchestra2026.01 | 261 | 0.22 | 0.07 | 0.46 | |
| ReflexionAgent2026.01 | 518 | 0.44 | 0.13 | 2.5 | |
| SCAgent2026.01 | 990 | 0.8 | 0.29 | 5.43 | |
| MAS-GPT2026.01 | 1,516 | 3.9 | 1.76 | 29.56 | |
| DebateAgent2026.01 | 2,178 | 2.04 | 0.55 | 7.65 | |
| MaAS2026.01 | 2,936 | 7.52 | 3.11 | 39.52 | |
| AFlow2026.01 | 7,404 | 12.38 | 4.52 | 56.94 | |
| ToolOrchestra2026.01 | 7,829 | 15.38 | 5.79 | 92.47 |