Multi-task Language Understanding on MMLUpro (test)
95.71AccuracySIGMA
Evaluation Results
| Method | Links | |
|---|---|---|
| SIGMAMulti-agent collaboration=full support, Inter-agent relations=full support, Handling conflicting signals=full support2026.05 | 95.71 | |
| G-DesignerMulti-agent collaboration=full support, Inter-agent relations=full support2026.05 | 95.31 | |
| GoAMulti-agent collaboration=full support, Inter-agent relations=full support2026.05 | 95.1 | |
| GPTSwarmMulti-agent collaboration=full support, Inter-agent relations=full support2026.05 | 94.87 | |
| Complete GraphMulti-agent collaboration=full support, Inter-agent relations=full support, Handling conflicting signals=no support2026.05 | 94.73 | |
| Random GraphMulti-agent collaboration=full support, Inter-agent relations=full support, Handling conflicting signals=no support2026.05 | 93.42 | |
| AutoGenMulti-agent collaboration=full support, Inter-agent relations=full support2026.05 | 93.29 | |
| SCMulti-agent collaboration=no support, Inter-agent relations=no support, Handling conflicting signals=no support2026.05 | 91.43 | |
| DyLANMulti-agent collaboration=full support, Inter-agent relations=full support2026.05 | 91.43 | |
| PHPMulti-agent collaboration=full support, Inter-agent relations=no support, Handling conflicting signals=no support2026.05 | 91.32 | |
| ComplexCoTMulti-agent collaboration=no support, Inter-agent relations=no support, Handling conflicting signals=no support2026.05 | 88.76 | |
| Self-MoAMulti-agent collaboration=full support, Inter-agent relations=no support, Handling conflicting signals=no support2026.05 | 88.69 | |
| MoAMulti-agent collaboration=full support, Inter-agent relations=no support, Handling conflicting signals=no support2026.05 | 88.57 | |
| CoTMulti-agent collaboration=no support, Inter-agent relations=no support, Handling conflicting signals=no support2026.05 | 87.58 | |
| VanillaMulti-agent collaboration=no support, Inter-agent relations=no support, Handling conflicting signals=no support2026.05 | 84.17 | |
| GPT-3.52025.01 | 74.8 | |
| SID-vModel=GPT-OSS-20B2025.10 | 71 | |
| SID-cModel=GPT-OSS-20B2025.10 | 70 | |
| Self-ConsistencyModel=GPT-OSS-20B2025.10 | 69 | |
| Self-ContrastModel=GPT-OSS-20B2025.10 | 65 | |
| DMADModel=GPT-OSS-20B2025.10 | 65 | |
| IOModel=GPT-OSS-20B2025.10 | 64 | |
| GPT-42025.01 | 63.71 | |
| COTModel=GPT-OSS-20B2025.10 | 61 | |
| SID-vModel=LLaMA3.1-8B2025.10 | 47 | |
| SID-cModel=LLaMA3.1-8B2025.10 | 47 | |
| Self-ConsistencyModel=LLaMA3.1-8B2025.10 | 45 | |
| MADModel=LLaMA3.1-8B2025.10 | 41 | |
| COTModel=LLaMA3.1-8B2025.10 | 39 | |
| DMADModel=LLaMA3.1-8B2025.10 | 39 | |
| Self-ContrastModel=LLaMA3.1-8B2025.10 | 36 | |
| TAMA2025.01 | 31.84 | |
| SBPModel=GPT-OSS-20B2025.10 | 26 | |
| IOModel=LLaMA3.1-8B2025.10 | 25 | |
| base2025.01 | 22.1 | |
| SBPModel=LLaMA3.1-8B2025.10 | 15 |