Mathematical Reasoning on OlympiadBench (Pass@1 Accuracy, Avg Token Length)
62.7Pass@1 AccuracyExpThink
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ExpThinkBackbone=Qwen3-8B2026.05 | 62.7 | 2,430 | |
| VanillaBackbone=Qwen3-8B2026.05 | 57.3 | 9,649.2 | |
| LaserBackbone=DeepSeek-R1-Distill-Qwen-7B2026.05 | 56.1 | 3,594.3 | |
| AutoThinkBackbone=DeepSeek-R1-Distill-Qwen-7B2026.05 | 55.7 | 4,968.7 | |
| AdaptThinkBackbone=DeepSeek-R1-Distill-Qwen-7B2026.05 | 55.7 | 5,603 | |
| ExpThinkBackbone=DeepSeek-R1-Distill-Qwen-7B2026.05 | 54.7 | 2,977.2 | |
| VanillaBackbone=DeepSeek-R1-Distill-Qwen-7B2026.05 | 54.4 | 7,364.1 | |
| LC-R1Backbone=DeepSeek-R1-Distill-Qwen-7B2026.05 | 54.2 | 4,206.2 | |
| JETBackbone=DeepSeek-R1-Distill-Qwen-7B2026.05 | 54.1 | 6,230.3 | |
| LaserBackbone=DeepSeek-R1-Distill-Qwen-1.5B2026.05 | 45.3 | 5,121.3 | |
| JETBackbone=DeepSeek-R1-Distill-Qwen-1.5B2026.05 | 45.2 | 6,490 | |
| AdaptThinkBackbone=DeepSeek-R1-Distill-Qwen-1.5B2026.05 | 44.6 | 3,978.2 | |
| ExpThinkBackbone=DeepSeek-R1-Distill-Qwen-1.5B2026.05 | 43 | 3,057.1 | |
| AutoThinkBackbone=DeepSeek-R1-Distill-Qwen-1.5B2026.05 | 42.4 | 5,158.8 | |
| VanillaBackbone=DeepSeek-R1-Distill-Qwen-1.5B2026.05 | 41.5 | 8,915.1 | |
| LC-R1Backbone=DeepSeek-R1-Distill-Qwen-1.5B2026.05 | 39.6 | 4,651.1 |