Scientific Reasoning on GPQA (Accuracy (%))
72.1Accuracy (%)ParaManager
Evaluation results
| Method | Links | |
|---|---|---|
| ParaManagerOrchestration Strategy=Unified2026.04 | 72.1 | |
| GPT-OSS-20BOrchestration Strategy=Majority Vote2026.04 | 71.21 | |
| GPT-OSS-20BOrchestration Strategy=Self Refine2026.04 | 69.44 | |
| EvoFlowOrchestration Strategy=Static Workflow2026.04 | 68.18 | |
| ParaManager-MonoOrchestration Strategy=Mono2026.04 | 67.49 | |
| ToolOrchestraOrchestration Strategy=Serial Orchestration2026.04 | 66.41 | |
| ParaManager-SFTOrchestration Strategy=SFT2026.04 | 66.29 | |
| GPT-OSS-20BOrchestration Strategy=Base+Tool2026.04 | 65.4 | |
| ParaManager-SerialOrchestration Strategy=Serial2026.04 | 65.03 | |
| PuppeteerOrchestration Strategy=Serial Orchestration2026.04 | 64.77 | |
| Qwen3-30B A3B-Instruct-2507Orchestration Strategy=Majority Vote2026.04 | 64.65 | |
| Qwen3-30B A3B-Instruct-2507Orchestration Strategy=Self Refine2026.04 | 64.39 | |
| Qwen3-30B A3B-Instruct-2507Orchestration Strategy=Base2026.04 | 63.13 | |
| Qwen3-4B Instruct-2507Orchestration Strategy=Majority Vote2026.04 | 62.63 | |
| GPT-OSS-20BOrchestration Strategy=Base2026.04 | 62.12 | |
| Qwen3-4B Instruct-2507Orchestration Strategy=Self Refine2026.04 | 60.1 | |
| Qwen3-30B A3B-Instruct-2507Orchestration Strategy=Base+Tool2026.04 | 59.97 | |
| Qwen3-4B Instruct-2507Orchestration Strategy=Base+Tool2026.04 | 59.34 | |
| RouterOrchestration Strategy=Static Workflow2026.04 | 59.22 | |
| Qwen3-4B Instruct-2507Orchestration Strategy=Base2026.04 | 59.09 | |
| Qwen3-Coder 30B-A3B-InstructOrchestration Strategy=Base+Tool2026.04 | 57.45 | |
| Qwen3-Coder 30B-A3B-InstructOrchestration Strategy=Self Refine2026.04 | 56.82 | |
| Meta Agent SearchOrchestration Strategy=Static Workflow2026.04 | 56.82 | |
| Qwen3-Coder 30B-A3B-InstructOrchestration Strategy=Majority Vote2026.04 | 55.05 | |
| Qwen3-Coder 30B-A3B-InstructOrchestration Strategy=Base2026.04 | 53.47 |