Multi-task Language Understanding on MMLU
99.7AccuracyM2CL
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| M2CLModel=Qwen-72B, Number of LLMs=642026.02 | 99.7 | — | — | — | — | — | — | — | |
| M2CLModel=Qwen-14B, Number of LLMs=642026.02 | 99.1 | — | — | — | — | — | — | — | |
| MacNetModel=Qwen-72B, Number of LLMs=642026.02 | 98 | — | — | — | — | — | — | — | |
| M2CLModel=Qwen-7B, Number of LLMs=642026.02 | 97.5 | — | — | — | — | — | — | — | |
| M2CLModel=Llama-14B, Number of LLMs=642026.02 | 96.8 | — | — | — | — | — | — | — | |
| M2CLModel=Llama-70B, Number of LLMs=642026.02 | 96.3 | — | — | — | — | — | — | — | |
| GPTSwarmModel=Llama-70B, Number of LLMs=642026.02 | 95.7 | — | — | — | — | — | — | — | |
| M2CLBackbone=Llama-70B, Number of LLMs=82026.02 | 95.4 | — | — | — | — | — | — | — | |
| DyLANModel=Llama-70B, Number of LLMs=642026.02 | 95.4 | — | — | — | — | — | — | — | |
| MacNetModel=Llama-70B, Number of LLMs=642026.02 | 95.3 | — | — | — | — | — | — | — | |
| M2CLBackbone=Qwen-72B, Number of LLMs=82026.02 | 95.1 | — | — | — | — | — | — | — | |
| DyLANModel=Qwen-72B, Number of LLMs=642026.02 | 95.1 | — | — | — | — | — | — | — | |
| GPTSwarmModel=Qwen-72B, Number of LLMs=642026.02 | 94.3 | — | — | — | — | — | — | — | |
| M2CLBackbone=Qwen-14B, Number of LLMs=82026.02 | 93.7 | — | — | — | — | — | — | — | |
| MacNetModel=Qwen-14B, Number of LLMs=642026.02 | 93.7 | — | — | — | — | — | — | — | |
| GPTSwarmBackbone=Llama-70B, Number of LLMs=82026.02 | 93.6 | — | — | — | — | — | — | — | |
| DyLANBackbone=Llama-70B, Number of LLMs=82026.02 | 93.5 | — | — | — | — | — | — | — | |
| M2CLBackbone=Llama-14B, Number of LLMs=82026.02 | 92.7 | — | — | — | — | — | — | — | |
| M2CLBackbone=Qwen-7B, Number of LLMs=82026.02 | 92.5 | — | — | — | — | — | — | — | |
| DyLANBackbone=Qwen-72B, Number of LLMs=82026.02 | 91.5 | — | — | — | — | — | — | — | |
| GPTSwarmBackbone=Qwen-72B, Number of LLMs=82026.02 | 91.5 | — | — | — | — | — | — | — | |
| Interfaze-Beta2026.02 | 91.38 | — | — | — | — | — | — | — | |
| DebateModel=Qwen-72B, Number of LLMs=642026.02 | 91.2 | — | — | — | — | — | — | — | |
| MacNetModel=Llama-14B, Number of LLMs=642026.02 | 90.8 | — | — | — | — | — | — | — | |
| GPT-4.12026.02 | 90.2 | — | — | — | — | — | — | — | |
| DyLANModel=Qwen-14B, Number of LLMs=642026.02 | 90.2 | — | — | — | — | — | — | — | |
| GPTSwarmModel=Qwen-14B, Number of LLMs=642026.02 | 90.2 | — | — | — | — | — | — | — | |
| DebateModel=Llama-70B, Number of LLMs=642026.02 | 90 | — | — | — | — | — | — | — | |
| Claude 3.5 Sonnetshot=5-shot, CoT=false2024.07 | 89.9 | — | — | — | — | — | — | — | |
| Average human expert2022.10 | 89.8 | — | — | — | — | — | — | — | |
| KALEBackbone=Qwen3-32B-thinking2026.01 | 89.44 | — | — | — | — | — | — | — | |
| Gemini 2.5 Pro2026.02 | 89.2 | — | — | — | — | — | — | — | |
| GPT-4oshot=5-shot, CoT=false2024.07 | 89.1 | — | — | — | — | — | — | — | |
| Claude Opus 4Reasoning=Thinking2026.02 | 89 | — | — | — | — | — | — | — | |
| Claude Sonnet 4Reasoning=Thinking2026.02 | 88.8 | — | — | — | — | — | — | — | |
| GPT-4oshot=0-shot, CoT=true2024.07 | 88.7 | — | — | — | — | — | — | — | |
| Llama 3 405Bshot=0-shot, CoT=true2024.07 | 88.6 | — | — | — | — | — | — | — | |
| Claude 3.5 Sonnetshot=0-shot, CoT=true2024.07 | 88.3 | — | — | — | — | — | — | — | |
| Llama 3 405Bshot=5-shot, CoT=false2024.07 | 87.3 | — | — | — | — | — | — | — | |
| G-DesignerDyn.=false, Dis.=false2025.11 | 87.2 | — | — | — | — | — | — | — | |
| GPTSwarmBackbone=Qwen-14B, Number of LLMs=82026.02 | 87 | — | — | — | — | — | — | — | |
| DyLANBackbone=Qwen-14B, Number of LLMs=82026.02 | 86.8 | — | — | — | — | — | — | — | |
| BiRouterDyn.=true, Dis.=true2025.11 | 86.8 | — | — | — | — | — | — | — | |
| DeepSeek-V3.2Access=Closed-source2026.01 | 86.73 | — | — | — | — | — | — | — | |
| DebateModel=Qwen-14B, Number of LLMs=642026.02 | 86.6 | — | — | — | — | — | — | — | |
| Llama 3 70Bshot=0-shot, CoT=true2024.07 | 86 | — | — | — | — | — | — | — | |
| SFTBackbone=Qwen3-32B-thinking2026.01 | 85.56 | — | — | — | — | — | — | — | |
| GPT-4 (0125)shot=0-shot, CoT=true2024.07 | 85.4 | — | — | — | — | — | — | — | |
| GPT-4 (0125)shot=5-shot, CoT=false2024.07 | 85.1 | — | — | — | — | — | — | — | |
| MacNetModel=Qwen-7B, Number of LLMs=642026.02 | 85.1 | — | — | — | — | — | — | — | |
| GPT-4oAccess=Closed-source2026.01 | 85.08 | — | — | — | — | — | — | — | |
| SE-GPTModel=GPT-42024.07 | 85 | — | — | — | — | — | — | — | |
| DyLANModel=Llama-14B, Number of LLMs=642026.02 | 85 | — | — | — | — | — | — | — | |
| BF16Backbone=DeepSeek-V3.1 671B2026.02 | 84.86 | — | — | — | — | — | — | — | |
| HiF4Backbone=DeepSeek-V3.1 671B2026.02 | 84.77 | — | — | — | — | — | -0.09 | — | |
| NVFP4+PTSBackbone=DeepSeek-V3.1 671B2026.02 | 84.72 | — | — | — | — | — | -0.14 | — | |
| NVFP4Backbone=DeepSeek-V3.1 671B2026.02 | 84.31 | — | — | — | — | — | -0.55 | — | |
| BoNBackbone=Qwen-72B, Number of LLMs=82026.02 | 84.2 | — | — | — | — | — | — | — | |
| BoNModel=Qwen-72B, Number of LLMs=642026.02 | 84.2 | — | — | — | — | — | — | — | |
| MacNetBackbone=Qwen-72B, Number of LLMs=82026.02 | 83.8 | — | — | — | — | — | — | — | |
| VanillaBackbone=Qwen3-32B-thinking2026.01 | 83.61 | — | — | — | — | — | — | — | |
| Llama 3 70Bshot=5-shot, CoT=false2024.07 | 83.6 | — | — | — | — | — | — | — | |
| Self-EXPModel=GPT-42024.07 | 83.4 | — | — | — | — | — | — | — | |
| GPT-42024.03 | 83 | — | — | — | — | — | — | — | |
| BoNBackbone=Llama-70B, Number of LLMs=82026.02 | 83 | — | — | — | — | — | — | — | |
| BoNModel=Llama-70B, Number of LLMs=642026.02 | 83 | — | — | — | — | — | — | — | |
| MacNetDyn.=false, Dis.=false2025.11 | 82.98 | — | — | — | — | — | — | — | |
| Ans. AugTraining Strategy=Answer-Based Augmentation, Backbone=Qwen-2.5-32B-Instruct2026.01 | 82.9 | — | — | — | — | — | — | — | |
| GPTSwarmDyn.=false, Dis.=false2025.11 | 82.8 | — | — | — | — | — | — | — | |
| DebateBackbone=Qwen-72B, Number of LLMs=82026.02 | 82.7 | — | — | — | — | — | — | — | |
| Nemotron 4 340Bshot=5-shot, CoT=false2024.07 | 82.6 | — | — | — | — | — | — | — | |
| Zero-shot-CoTModel=GPT-42024.07 | 82.2 | — | — | — | — | — | — | — | |
| DebateBackbone=Llama-70B, Number of LLMs=82026.02 | 82.2 | — | — | — | — | — | — | — | |
| DyLANBackbone=Llama-14B, Number of LLMs=82026.02 | 82.1 | — | — | — | — | — | — | — | |
| MacNetBackbone=Llama-70B, Number of LLMs=82026.02 | 82 | — | — | — | — | — | — | — | |
| Llama 70B2026.02 | 81.78 | — | — | — | — | — | — | — | |
| MacNetBackbone=Llama-14B, Number of LLMs=82026.02 | 81.7 | — | — | — | — | — | — | — | |
| M2CLModel=Llama-7B, Number of LLMs=642026.02 | 81.5 | — | — | — | — | — | — | — | |
| LLM-BlenderDyn.=false, Dis.=false2025.11 | 81.22 | — | — | — | — | — | — | — | |
| Flan-PaLM 2 (L)shot=5-shot2023.05 | 81.2 | — | — | — | — | — | — | — | |
| AUTOIF (Qwen2-72B-Instruct w/ Online DPO)Backbone Model=Qwen2-72B-Instruct, Supervision Model=Qwen2-72B, Alignment Strategy=Self-Alignment, Training Method=Online DPO2024.06 | 81.2 | — | — | — | — | — | — | — | |
| Know. AugTraining Strategy=Knowledge-Based Augmentation, Backbone=Qwen-2.5-32B-Instruct2026.01 | 81.1 | — | — | — | — | — | — | — | |
| ComplexCoT2025.11 | 81.05 | — | — | — | — | — | — | — | |
| LLM-DebateDyn.=false, Dis.=false2025.11 | 81.04 | — | — | — | — | — | — | — | |
| SC (CoTx5)2025.11 | 80.96 | — | — | — | — | — | — | — | |
| GPTSwarmModel=Qwen-7B, Number of LLMs=642026.02 | 80.9 | — | — | — | — | — | — | — | |
| Qwen2-72B-InstructBackbone Model=Qwen2-72B-Instruct2024.06 | 80.8 | — | — | — | — | — | — | — | |
| AUTOIF (LLaMA-3-70B w/ Online DPO)Backbone Model=LLaMA3-70B-Instruct, Supervision Model=LLaMA3-70B, Alignment Strategy=Self-Alignment, Training Method=Online DPO2024.06 | 80.7 | — | — | — | — | — | — | — | |
| LLaMA3-70B-InstructBackbone Model=LLaMA3-70B-Instruct2024.06 | 80.5 | — | — | — | — | — | — | — | |
| Cont-Squeezerank=128 to 1, additional_steps=7002026.02 | 80.17 | — | — | — | — | — | — | — | |
| In-Squeezerank=128 to 1, schedule=Min steps2026.02 | 80.16 | — | — | — | — | — | — | — | |
| SATTraining Strategy=Structure-Aware Training, Backbone=Qwen-2.5-32B-Instruct2026.01 | 80.1 | — | — | — | — | — | — | — | |
| No ControlBackbone=Qwen2-72B-Instruct2024.11 | 80.05 | — | — | — | — | — | — | — | |
| DyLANDyn.=true, Dis.=false2025.11 | 79.96 | — | — | — | — | — | — | — | |
| Mixtral 8x22Bshot=0-shot, CoT=true2024.07 | 79.9 | — | — | — | — | — | — | — | |
| DyLANModel=Qwen-7B, Number of LLMs=642026.02 | 79.8 | — | — | — | — | — | — | — | |
| SAC Single-taskBackbone=Qwen2-72B-Instruct2024.11 | 79.75 | — | — | — | — | — | — | — | |
| In-Squeezerank=128 to 1, schedule=Standard2026.02 | 79.75 | — | — | — | — | — | — | — | |
| BoNBackbone=Qwen-14B, Number of LLMs=82026.02 | 79.7 | — | — | — | — | — | — | — | |
| BoNModel=Qwen-14B, Number of LLMs=642026.02 | 79.7 | — | — | — | — | — | — | — |