Math on GSM8K, MATH-500 (test)
92.6GSM8K AccuracyREAP
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| REAPModel=Qwen3, Ratio=25%, Zero-shot=true2026.03 | 92.6 | 77.8 | 85.2 | |
| FullModel=Qwen3, Ratio=0%, Zero-shot=true2026.03 | 92.3 | 80.2 | 86.2 | |
| SEERModel=Qwen3, Ratio=25%, Zero-shot=true2026.03 | 91.3 | 20.2 | 55.7 | |
| EANModel=Qwen3, Ratio=25%, Zero-shot=true2026.03 | 90.7 | 20 | 55.4 | |
| FrequencyModel=Qwen3, Ratio=25%, Zero-shot=true2026.03 | 90.4 | 19.6 | 55 | |
| AIMERModel=Qwen3, Ratio=25%, Zero-shot=true2026.03 | 89.5 | 75.6 | 82.6 | |
| REAPModel=Qwen3, Ratio=50%, Zero-shot=true2026.03 | 89.5 | 80.4 | 84.9 | |
| MagnitudeModel=Qwen3, Ratio=25%, Zero-shot=true2026.03 | 88.4 | 80.8 | 84.6 | |
| RandomModel=Qwen3, Ratio=25%, Zero-shot=true2026.03 | 80.7 | 57.4 | 69.1 | |
| AIMERModel=Qwen3, Ratio=50%, Zero-shot=true2026.03 | 66.4 | 49.4 | 57.9 | |
| EANModel=Qwen3, Ratio=50%, Zero-shot=true2026.03 | 65 | 3.2 | 34.1 | |
| RandomModel=Qwen3, Ratio=50%, Zero-shot=true2026.03 | 8.5 | 3.8 | 6.1 | |
| FrequencyModel=Qwen3, Ratio=50%, Zero-shot=true2026.03 | 0 | 0 | 0 | |
| SEERModel=Qwen3, Ratio=50%, Zero-shot=true2026.03 | 0 | 0 | 0 | |
| MagnitudeModel=Qwen3, Ratio=50%, Zero-shot=true2026.03 | 0 | 0 | 0 |