Mathematical Reasoning on AIME 24 (Avg@32 Accuracy)
93.85Avg@32 AccuracyFlashMLA
Evaluation Results
| Method | Links | |
|---|---|---|
| FlashMLABackbone=DeepSeek-V3.1, Precision=BF162026.02 | 93.85 | |
| SnapMLABackbone=DeepSeek-V3.1, Precision=FP82026.02 | 93.65 | |
| FlashMLABackbone=LongCat-Flash-thinking, Precision=BF162026.02 | 91.87 | |
| SnapMLABackbone=LongCat-Flash-thinking, Precision=FP82026.02 | 91.67 | |
| PCLBackbone=DeepSeek-R1-Distill-7B, Strategy=PCL, Runtime=50h2026.02 | 52.8 | |
| GPSBackbone=DeepSeek-R1-Distill-7B, Strategy=GPS, Runtime=49h2026.02 | 51.8 | |
| Dynamic Sampling (Oracle)Backbone=DeepSeek-R1-Distill-7B, Strategy=DS, Runtime=77h2026.02 | 51 | |
| Uniform SamplingBackbone=DeepSeek-R1-Distill-7B, Strategy=Uniform, Runtime=40h2026.02 | 50.9 | |
| MoPPSBackbone=DeepSeek-R1-Distill-7B, Strategy=MoPPS, Runtime=42h2026.02 | 50.8 | |
| GRESOBackbone=DeepSeek-R1-Distill-7B, Strategy=GRESO, Runtime=53h2026.02 | 49.8 | |
| DeepSeek-R1-Distill-7BBackbone=DeepSeek-R1-Distill-7B, Strategy=Base2026.02 | 38.8 | |
| OTBBackbone=Qwen3-8b-Base, Reasoning Paradigm=Single-Turn2026.02 | 37.29 | |
| OPOBackbone=Qwen3-8b-Base, Reasoning Paradigm=Single-Turn2026.02 | 35.31 | |
| Dynamic Sampling (Oracle)Backbone=DeepSeek-R1-Distill-1.5B, Strategy=DS, Runtime=30h2026.02 | 34.7 | |
| PCLBackbone=DeepSeek-R1-Distill-1.5B, Strategy=PCL, Runtime=17h2026.02 | 34.2 | |
| MoPPSBackbone=DeepSeek-R1-Distill-1.5B, Strategy=MoPPS, Runtime=17h2026.02 | 34 | |
| GPSBackbone=DeepSeek-R1-Distill-1.5B, Strategy=GPS, Runtime=16h2026.02 | 33.8 | |
| OGBBackbone=Qwen3-8b-Base, Reasoning Paradigm=Single-Turn2026.02 | 33.13 | |
| Uniform SamplingBackbone=DeepSeek-R1-Distill-1.5B, Strategy=Uniform, Runtime=16h2026.02 | 32.4 | |
| GRESOBackbone=DeepSeek-R1-Distill-1.5B, Strategy=GRESO, Runtime=27h2026.02 | 31.5 | |
| GRPOBackbone=Qwen3-8b-Base, Reasoning Paradigm=Single-Turn2026.02 | 31.35 | |
| RLOOBackbone=Qwen3-8b-Base, Reasoning Paradigm=Single-Turn2026.02 | 28.96 | |
| DeepSeek-R1-Distill-1.5BBackbone=DeepSeek-R1-Distill-1.5B, Strategy=Base2026.02 | 20.8 |