Reasoning on MMLU (test)
92.87Accuracy (Natural Sciences)TopoPrior+ARG
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| TopoPrior+ARGBase model=DeepSeek-V3-671B-Instruct2026.05 | 92.87 | — | 93.14 | 92.55 | 95.12 | 87.83 | 87.08 | 92.79 | 92.03 | |
| TopoPrior+ADBase model=DeepSeek-V3-671B-Instruct2026.05 | 91.78 | — | 92.09 | 91.33 | 93.95 | 86.95 | 86.51 | 91.74 | 90.62 | |
| ARG-DesignerBase model=DeepSeek-V3-671B-Instruct2026.05 | 91.15 | — | 91.8 | 91.07 | 93.69 | 86.28 | 85.52 | 91.48 | 90.14 | |
| TopoPrior+ARGBase model=Qwen2.5-72B-Instruct2026.05 | 90.87 | — | 91.18 | 90.64 | 92.62 | 86.76 | 86.01 | 90.89 | 89.56 | |
| TopoPrior+APBase model=DeepSeek-V3-671B-Instruct2026.05 | 90.75 | — | 90.9 | 90.41 | 92.89 | 86.01 | 85.31 | 90.65 | 90.41 | |
| TopoPrior+GDBase model=DeepSeek-V3-671B-Instruct2026.05 | 90.12 | — | 90.46 | 89.82 | 92.37 | 85.43 | 84.71 | 90.28 | 89.89 | |
| AgentDropoutBase model=DeepSeek-V3-671B-Instruct2026.05 | 89.97 | — | 90.5 | 90.11 | 91.93 | 85.29 | 84.89 | 90.25 | 88.99 | |
| AgentPruneBase model=DeepSeek-V3-671B-Instruct2026.05 | 89.84 | — | 90.03 | 89.52 | 91.47 | 84.73 | 83.98 | 89.76 | 89.19 | |
| TopoPrior+ADBase model=Qwen2.5-72B-Instruct2026.05 | 89.48 | — | 89.62 | 89.35 | 91.26 | 85.45 | 84.75 | 89.89 | 88.54 | |
| G-DesignerBase model=DeepSeek-V3-671B-Instruct2026.05 | 89.23 | — | 89.67 | 88.91 | 91.08 | 84.12 | 83.46 | 89.35 | 88.52 | |
| ARG-DesignerBase model=Qwen2.5-72B-Instruct2026.05 | 88.5 | — | 88.87 | 88.41 | 90.4 | 84.49 | 83.55 | 88.69 | 87.56 | |
| TopoPrior+GDBase model=Qwen2.5-72B-Instruct2026.05 | 88.31 | — | 88.44 | 88.13 | 90.01 | 84.3 | 83.29 | 88.32 | 87.26 | |
| TopoPrior+APBase model=Qwen2.5-72B-Instruct2026.05 | 87.74 | — | 87.61 | 87.49 | 89.33 | 83.58 | 82.73 | 87.64 | 86.59 | |
| AgentDropoutBase model=Qwen2.5-72B-Instruct2026.05 | 87.63 | — | 87.79 | 87.4 | 89.32 | 83.59 | 82.7 | 87.74 | 86.6 | |
| G-DesignerBase model=Qwen2.5-72B-Instruct2026.05 | 87.42 | — | 87.55 | 87.2 | 88.97 | 83.19 | 82.58 | 87.43 | 86.33 | |
| AgentPruneBase model=Qwen2.5-72B-Instruct2026.05 | 86.67 | — | 86.98 | 86.44 | 88.42 | 82.56 | 81.81 | 86.69 | 85.71 | |
| RAGBase model=DeepSeek-V3-671B-Instruct2026.05 | 85.92 | — | 86.17 | 85.84 | 87.63 | 82.45 | 81.78 | 86.05 | 85.38 | |
| RAGBase model=Qwen2.5-72B-Instruct2026.05 | 85.71 | — | 86.02 | 85.48 | 87.43 | 82.33 | 81.58 | 85.73 | 85.56 | |
| CoTBase model=Qwen2.5-72B-Instruct2026.05 | 85.02 | — | 84.4 | 84.79 | 86.71 | 81.17 | 80.42 | 85.07 | 84.41 | |
| PEBase model=DeepSeek-V3-671B-Instruct2026.05 | 84.96 | — | 85.23 | 84.78 | 86.41 | 79.63 | 78.92 | 85.12 | 84.47 | |
| CoTBase model=DeepSeek-V3-671B-Instruct2026.05 | 84.6 | — | 84.85 | 85.32 | 86.87 | 80.19 | 79.52 | 85.57 | 84.9 | |
| PEBase model=Qwen2.5-72B-Instruct2026.05 | 84.17 | — | 84.44 | 83.86 | 85.53 | 79.84 | 79.19 | 83.92 | 83.26 | |
| TopoPrior+ARGBase model=Llama3-8B-Instruct2026.05 | 68.91 | — | 71.57 | 68.13 | 72.74 | 66.15 | 64.08 | 68.14 | 68.53 | |
| TopoPrior+GDBase model=Llama3-8B-Instruct2026.05 | 66.32 | — | 67.8 | 65.42 | 70.41 | 63.96 | 60.85 | 67.18 | 65.99 | |
| TopoPrior+ADBase model=Llama3-8B-Instruct2026.05 | 65.7 | — | 69.95 | 65.47 | 70.36 | 66.88 | 63.75 | 69.05 | 67.31 | |
| ARG-DesignerBase model=Llama3-8B-Instruct2026.05 | 65.48 | — | 68.01 | 64.95 | 69.54 | 63.86 | 61.32 | 65.87 | 65.58 | |
| TopoPrior+APBase model=Llama3-8B-Instruct2026.05 | 65.34 | — | 68.75 | 65.19 | 69.16 | 63.93 | 61.8 | 67.62 | 65.97 | |
| G-DesignerBase model=Llama3-8B-Instruct2026.05 | 64.82 | — | 66.57 | 63.91 | 67.7 | 61.58 | 59.13 | 65.44 | 64.16 | |
| AgentDropoutBase model=Llama3-8B-Instruct2026.05 | 64.3 | — | 69.72 | 63.14 | 68.86 | 65.47 | 62.05 | 66.53 | 65.72 | |
| AgentPruneBase model=Llama3-8B-Instruct2026.05 | 63.99 | — | 66.85 | 64.73 | 66.98 | 63.07 | 58.51 | 64.12 | 64.04 | |
| RAGBase model=Llama3-8B-Instruct2026.05 | 61.65 | — | 62.39 | 62.95 | 65.37 | 58.03 | 54.5 | 62.83 | 61.1 | |
| MoDEBase model=Llama3-8B-Instruct2026.05 | 59.72 | — | 63.05 | 62.45 | 64.69 | 56.79 | 54.11 | 61.06 | 60.12 | |
| CoTBase model=Llama3-8B-Instruct2026.05 | 58.97 | — | 61.51 | 59.02 | 62.48 | 50.65 | 46.76 | 60.68 | 57.15 | |
| DES-MoEBase model=Llama3-8B-Instruct2026.05 | 58.88 | — | 62.34 | 60.7 | 62.63 | 54.84 | 52.98 | 61.33 | 59.1 | |
| PEBase model=Llama3-8B-Instruct2026.05 | 57.84 | — | 58.89 | 56.61 | 60.05 | 49.84 | 45.72 | 59.4 | 55.05 | |
| MoDULABase model=Llama3-8B-Instruct2026.05 | 56.89 | — | 58.72 | 57.95 | 61.22 | 51.6 | 48.42 | 60.53 | 56.47 | |
| AdamWOptimizer=AdamW, Model Parameters=1B, Training Tokens=100B, Codebase=OLMo2025.10 | — | 23 | — | — | — | — | — | — | — | |
| AdamW+CWDOptimizer=AdamW+CWD, Model Parameters=1B, Training Tokens=100B, Codebase=OLMo2025.10 | — | 25 | — | — | — | — | — | — | — | |
| MuonOptimizer=Muon, Model Parameters=1B, Training Tokens=100B, Codebase=OLMo2025.10 | — | 24 | — | — | — | — | — | — | — | |
| Muon+CWDOptimizer=Muon+CWD, Model Parameters=1B, Training Tokens=100B, Codebase=OLMo2025.10 | — | 26 | — | — | — | — | — | — | — |