Competition Math on AIME 2025 (accuracy)
40.8AccuracyVanilla
Evaluation Results
| Method | Links | |
|---|---|---|
| VanillaModel=Qwen 2.5 R1 7B, Compression Ratio (CR)=1, Sampling temperature=0.6, top-p=95%, Number of runs=82025.11 | 40.8 | |
| kvtcModel=Qwen 2.5 R1 7B, Compression Ratio (CR)=9-11, Variant=8x, Sampling temperature=0.6, top-p=95%, Number of runs=82025.11 | 40.8 | |
| kvtcModel=Qwen 2.5 R1 7B, Compression Ratio (CR)=18-21, Variant=16x, Sampling temperature=0.6, top-p=95%, Number of runs=82025.11 | 38.3 | |
| kvtcModel=Qwen 2.5 R1 1.5B, Compression Ratio (CR)=9, Variant=8x, Sampling temperature=0.6, top-p=95%, Number of runs=82025.11 | 24.2 | |
| kvtcModel=Qwen 2.5 R1 1.5B, Compression Ratio (CR)=18, Variant=16x, Sampling temperature=0.6, top-p=95%, Number of runs=82025.11 | 22.5 | |
| VanillaModel=Qwen 2.5 R1 1.5B, Compression Ratio (CR)=1, Sampling temperature=0.6, top-p=95%, Number of runs=82025.11 | 21.7 |