Reasoning on AIME (pass@1 accuracy)
73.33Pass@1 AccuracyBaseline
Evaluation results
| Method | Links | |
|---|---|---|
| BaselineModel=QwQ-32B, Bit-Width=16-162025.10 | 73.33 | |
| ThinKV (k=1024)Model=QwQ-32B, Bit-Width=3.4-3.42025.10 | 70.28 | |
| PM-KVQModel=QwQ-32B, Bit-Width=3.5-3.52025.10 | 67.86 | |
| KIVIModel=QwQ-32B, Bit-Width=2-22025.10 | 60.56 | |
| BaselineModel=R1-Qwen-14B, Bit-Width=16-162025.10 | 53.33 | |
| ThinKV (k=1024)Model=R1-Qwen-14B, Bit-Width=3.5-3.52025.10 | 50 | |
| PM-KVQModel=R1-Qwen-14B, Bit-Width=3.2-3.22025.10 | 43.33 | |
| KIVIModel=R1-Qwen-14B, Bit-Width=2-22025.10 | 40 |