Accuracy on RACE Reading Comprehension
93.3Accuracy (RACE)Mistral-Large-3 675B-Base-2512
Evaluation Results
| Method | Links | |
|---|---|---|
| Mistral-Large-3 675B-Base-2512shots=0-shot2026.06 | 93.3 | |
| DeepSeek-V3.2 Exp-Baseshots=0-shot2026.06 | 93.21 | |
| Nemotron-3-Ultra 550B-A55B-Baseshots=0-shot2026.06 | 92.15 | |
| GLM-4.5 Baseshots=0-shot2026.06 | 92.15 | |
| Kimi-K2 Baseshots=0-shot2026.06 | 91.96 | |
| Llama-3.2Size=1.2B2025.04 | 37.8 | |
| CLIMBSize=950M2025.04 | 36.65 | |
| TinyLlamaSize=364.62025.04 | 36.46 | |
| Qwen2.5Size=490M2025.04 | 34.93 | |
| SmolLMSize=360M2025.04 | 34.74 | |
| AMD-OLMoSize=1.2B2025.04 | 34.64 | |
| MoE baselineModel Family=MoE2026.06 | 34.6 | |
| 2B constant-widthModel Family=Dense2026.06 | 34.3 | |
| MoE > <formerModel Family=MoE2026.06 | 34.3 | |
| 2B > <formerModel Family=Dense2026.06 | 33.4 | |
| CLIMBSize=350M2025.04 | 33.39 | |
| RegMix-DProxy models=512, Mode=Online2026.06 | 32.06 | |
| RegMix-DProxy models=512, Mode=Offline2026.06 | 31.83 | |
| RegMix-DProxy models=128, Mode=Offline2026.06 | 31.21 | |
| DoReMi2026.06 | 31.07 | |
| RegMix-DProxy models=128, Mode=Online2026.06 | 30.91 | |
| RegMix2026.06 | 30.75 | |
| Human2026.06 | 29.87 | |
| MIRParameters=1.4B, Training Data=DCLM, Training Tokens=100M, Evaluation=Zero-shot2026.06 | 27.66 | |
| Regularized BaselineParameters=1.4B, Training Data=DCLM, Training Tokens=100M, Evaluation=Zero-shot2026.06 | 26.89 | |
| Random GuessParameters=1.4B, Training Data=DCLM, Training Tokens=100M, Evaluation=Zero-shot2026.06 | 25 |