Multi-task Language Understanding on MMLU Pro (Subject Breakdown)
76.88MMLU Pro Engineering AccQwen3-Next-80B-A3B-Thinking
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Qwen3-Next-80B-A3B-ThinkingN. Params=80B, MoE=true, Reasoning=true2025.12 | 76.88 | 75.06 | 72.95 | — | |
| WMDBase Model=Qwen3-Next-80B-A3B-Thinking, N. Params=80B, MoE=true, Reasoning=true, Train Dataset=China-centric, Top-k Layers=8, Coeff=-0.25, Reposition=false2025.12 | 74.92 | 75.92 | 73.35 | — | |
| MDBase Model=Qwen3-Next-80B-A3B-Thinking, N. Params=80B, MoE=true, Reasoning=true, Train Dataset=Extended, Top-k Layers=4, Coeff=-1, Reposition=false2025.12 | 74.72 | 76.77 | 72.14 | — | |
| WRMDBase Model=Qwen3-Next-80B-A3B-Thinking, N. Params=80B, MoE=true, Reasoning=true, Train Dataset=China-centric, Top-k Layers=8, Coeff=-0.25, Reposition=false2025.12 | 73.37 | 76.16 | 71.34 | — | |
| MDBase Model=Qwen3-Next-80B-A3B-Thinking, N. Params=80B, MoE=true, Reasoning=true, Train Dataset=China-centric, Top-k Layers=4, Coeff=-0.5, Reposition=false2025.12 | 72.55 | 74.82 | 69.34 | — | |
| RMDBase Model=Qwen3-Next-80B-A3B-Thinking, N. Params=80B, MoE=true, Reasoning=true, Train Dataset=China-centric, Top-k Layers=4, Coeff=-0.75, Reposition=false2025.12 | 71.52 | 74.94 | 69.74 | — | |
| WMDBase Model=Qwen3-Next-80B-A3B-Thinking, N. Params=80B, MoE=true, Reasoning=true, Train Dataset=Extended, Top-k Layers=8, Coeff=-0.25, Reposition=false2025.12 | 71.41 | 75.67 | 72.55 | — | |
| RMDBase Model=Qwen3-Next-80B-A3B-Thinking, N. Params=80B, MoE=true, Reasoning=true, Train Dataset=Extended, Top-k Layers=4, Coeff=-2, Reposition=false2025.12 | 70.79 | 76.28 | 72.14 | — | |
| WRMDBase Model=Qwen3-Next-80B-A3B-Thinking, N. Params=80B, MoE=true, Reasoning=true, Train Dataset=Extended, Top-k Layers=16, Coeff=-0.15, Reposition=false2025.12 | 67.7 | 75.31 | 69.54 | — | |
| ExpRAGLLM Backbone=Claude 3.7 Sonnet2025.11 | 67 | — | 80 | 85 | |
| Qwen3-Next-4B-ThinkingN. Params=4B, MoE=false, Reasoning=true2025.12 | 66.77 | 67.11 | 55.31 | — | |
| WRMDBase Model=Qwen3-Next-4B-Thinking, N. Params=4B, MoE=false, Reasoning=true, Train Dataset=Extended, Top-k Layers=2, Coeff=-2, Reposition=false2025.12 | 66.15 | 67.48 | 57.11 | — | |
| SelfRAGLLM Backbone=Claude 3.7 Sonnet2025.11 | 65 | — | 77 | 84 | |
| ReMemLLM Backbone=Claude 3.7 Sonnet2025.11 | 65 | — | 80 | 86 | |
| HistoryLLM Backbone=Claude 3.7 Sonnet2025.11 | 64 | — | 78 | 85 | |
| MemOSLLM Backbone=Claude 3.7 Sonnet2025.11 | 64 | — | 76 | 84 | |
| BaselineLLM Backbone=Claude 3.7 Sonnet2025.11 | 63 | — | 78 | 84 | |
| ReActLLM Backbone=Claude 3.7 Sonnet2025.11 | 63 | — | 76 | 84 | |
| AmemLLM Backbone=Claude 3.7 Sonnet2025.11 | 63 | — | 79 | 83 | |
| ExpRecentLLM Backbone=Claude 3.7 Sonnet2025.11 | 63 | — | 78 | 86 | |
| Mem0LLM Backbone=Claude 3.7 Sonnet2025.11 | 62 | — | 77 | 84 | |
| Qwen3-Next-4B-InstructN. Params=4B, MoE=false, Reasoning=false2025.12 | 61.61 | 67.24 | 58.72 | — | |
| WRMDBase Model=Qwen3-Next-4B-Instruct, N. Params=4B, MoE=false, Reasoning=false, Train Dataset=Extended, Top-k Layers=4, Coeff=-0.5, Reposition=false2025.12 | 61.2 | 66.14 | 59.32 | — | |
| LangMemLLM Backbone=Claude 3.7 Sonnet2025.11 | 56 | — | 66 | 77 | |
| AWMLLM Backbone=Claude 3.7 Sonnet2025.11 | 56 | — | 72 | 80 | |
| DC-CuLLM Backbone=Claude 3.7 Sonnet2025.11 | 52 | — | 65 | 79 | |
| DC-RSLLM Backbone=Claude 3.7 Sonnet2025.11 | 52 | — | 60 | 79 | |
| BaselineLLM Backbone=Gemini 2.5 Flash2025.11 | 46 | — | 75 | 83 | |
| MemOSLLM Backbone=Gemini 2.5 Flash2025.11 | 46 | — | 75 | 82 | |
| Mem0LLM Backbone=Gemini 2.5 Flash2025.11 | 46 | — | 74 | 83 | |
| ReMemLLM Backbone=Gemini 2.5 Flash2025.11 | 46 | — | 79 | 85 | |
| SelfRAGLLM Backbone=Gemini 2.5 Flash2025.11 | 45 | — | 75 | 83 | |
| DC-CuLLM Backbone=Gemini 2.5 Flash2025.11 | 44 | — | 69 | 79 | |
| AWMLLM Backbone=Gemini 2.5 Flash2025.11 | 43 | — | 72 | 79 | |
| ExpRAGLLM Backbone=Gemini 2.5 Flash2025.11 | 43 | — | 78 | 83 | |
| HistoryLLM Backbone=Gemini 2.5 Flash2025.11 | 42 | — | 78 | 84 | |
| AmemLLM Backbone=Gemini 2.5 Flash2025.11 | 42 | — | 72 | 83 | |
| DC-RSLLM Backbone=Gemini 2.5 Flash2025.11 | 42 | — | 69 | 80 | |
| LangMemLLM Backbone=Gemini 2.5 Flash2025.11 | 39 | — | 71 | 79 | |
| ExpRecentLLM Backbone=Gemini 2.5 Flash2025.11 | 39 | — | 75 | 83 | |
| ReActLLM Backbone=Gemini 2.5 Flash2025.11 | 16 | — | 54 | 64 |