Reasoning on AIME, MATH, and GPQA Aggregate
62.44Overall ScorePolarQuant44
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PolarQuant44Backbone=DeepSeek-R1-Distill-Llama-8B, Quantization=PolarQuant442025.02 | 62.44 | 0.43 | |
| Bf16Backbone=DeepSeek-R1-Distill-Llama-8B, Quantization=Bf162025.02 | 62.01 | — | |
| ZipCache-4Backbone=DeepSeek-R1-Distill-Llama-8B, Quantization=ZipCache-42025.02 | 61.13 | -0.88 | |
| KIVI-4Backbone=DeepSeek-R1-Distill-Llama-8B, Quantization=KIVI-42025.02 | 59.71 | -2.3 | |
| Bf16Backbone=DeepSeek-R1-Distill-Qwen-1.5B, Quantization=Bf162025.02 | 51.7 | — | |
| PolarQuant44Backbone=DeepSeek-R1-Distill-Qwen-1.5B, Quantization=PolarQuant442025.02 | 47.69 | -3.31 | |
| KIVI-4Backbone=DeepSeek-R1-Distill-Qwen-1.5B, Quantization=KIVI-42025.02 | 45.3 | -6.4 |