Mathematical Reasoning on Olympiad Bench (test)
83.53Pass@1 AccuracyEDS
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| EDSBackbone=QWQ-32B2026.02 | 83.53 | 8,710 | |
| BaseBackbone=QWQ-32B2026.02 | 81.9 | 9,602 | |
| Full-suppressBackbone=QWQ-32B2026.02 | 81.45 | 8,454 | |
| BaseBackbone=Qwen3-8B2026.02 | 80.42 | 10,480 | |
| EDSBackbone=Qwen3-8B2026.02 | 79.82 | 9,739 | |
| Full-suppressBackbone=Qwen3-8B2026.02 | 79.53 | 9,540 | |
| BaseBackbone=DeepSeek-7B2026.02 | 69 | 7,913 | |
| EDSBackbone=DeepSeek-7B2026.02 | 67.95 | 7,183 | |
| Full-suppressBackbone=DeepSeek-7B2026.02 | 66.91 | 7,002 | |
| Evo-L2S-02Model Scale=7B, Merging Strategy=Multi-Objective Evolutionary Merging2026.04 | 52.9 | 2,932.2 | |
| Evo-L2S-01Model Scale=7B, Merging Strategy=Multi-Objective Evolutionary Merging2026.04 | 51.1 | 4,206.5 | |
| Evo-L2S (Accuracy)Model Scale=7B, Merging Strategy=Single-Objective Evolutionary Merging2026.04 | 50.7 | 4,147 | |
| ACM-TAModel Scale=7B, Merging Strategy=Activation-informed Merging (ACM)2026.04 | 50.2 | 2,292.2 | |
| Task ArithmeticModel Scale=7B, Merging Strategy=Arithmetic Merging2026.04 | 49.3 | 4,304.3 | |
| TIES-MergingModel Scale=7B, Merging Strategy=Arithmetic Merging2026.04 | 48.7 | 2,610.8 | |
| Average MergingModel Scale=7B, Merging Strategy=Arithmetic Merging2026.04 | 47.9 | 2,223.1 | |
| DeepSeek-R1-Distill-Qwen-7BModel Scale=7B2026.04 | 47.7 | 6,187.3 | |
| Evo-L2S-03Model Scale=7B, Merging Strategy=Multi-Objective Evolutionary Merging2026.04 | 47.7 | 2,433.8 | |
| ACM-TIESModel Scale=7B, Merging Strategy=Activation-informed Merging (ACM)2026.04 | 45 | 2,140.1 | |
| ACM-AverageModel Scale=7B, Merging Strategy=Activation-informed Merging (ACM)2026.04 | 41.8 | 1,981.5 | |
| Evo-L2S-04Model Scale=7B, Merging Strategy=Multi-Objective Evolutionary Merging2026.04 | 40.7 | 1,448.5 | |
| Evo-L2S (Length)Model Scale=7B, Merging Strategy=Single-Objective Evolutionary Merging2026.04 | 37 | 1,295.7 | |
| Evo-L2S-05Model Scale=7B, Merging Strategy=Multi-Objective Evolutionary Merging2026.04 | 36.9 | 1,283.2 | |
| Qwen2.5-Math-7BModel Scale=7B2026.04 | 17 | 1,228.2 |