Zero-shot Reasoning on ARC-e, HellaSwag, PIQA, and Winogrande
77.2Normalized Avg AccuracyBF16
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| BF16Model Size=32B, Bits=16-bit, Backbone=Qwen32025.05 | 77.2 | — | — | — | — | — | |
| BF16Model Size=14B, Bits=16-bit, Backbone=Qwen32025.05 | 75.4 | — | — | — | — | — | |
| BF16Model Size=8B, Bits=16-bit, Backbone=Qwen32025.05 | 72.4 | — | — | — | — | — | |
| BF16Model Size=4B, Bits=16-bit, Backbone=Qwen32025.05 | 68.9 | — | — | — | — | — | |
| BF16Model Size=1.7B, Bits=16-bit, Backbone=Qwen32025.05 | 61.4 | — | — | — | — | — | |
| BF16Model Size=0.6B, Bits=16-bit, Backbone=Qwen32025.05 | 51.1 | — | — | — | — | — | |
| QronosModel Size=32B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 48 | — | — | — | — | — | |
| GPTAQModel Size=32B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 47.3 | — | — | — | — | — | |
| OPTQModel Size=32B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 47 | — | — | — | — | — | |
| GPFQModel Size=32B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 46 | — | — | — | — | — | |
| QronosModel Size=14B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 45.2 | — | — | — | — | — | |
| QronosModel Size=8B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 44.7 | — | — | — | — | — | |
| GPTAQModel Size=14B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 43.3 | — | — | — | — | — | |
| OPTQModel Size=14B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 42.5 | — | — | — | — | — | |
| GPTAQModel Size=8B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 42.5 | — | — | — | — | — | |
| QronosModel Size=4B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 41.5 | — | — | — | — | — | |
| OPTQModel Size=8B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 41.4 | — | — | — | — | — | |
| GPFQModel Size=14B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 40.4 | — | — | — | — | — | |
| GPFQModel Size=8B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 39.4 | — | — | — | — | — | |
| GPTAQModel Size=4B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 38.7 | — | — | — | — | — | |
| OPTQModel Size=4B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 37.4 | — | — | — | — | — | |
| QronosModel Size=1.7B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 36.7 | — | — | — | — | — | |
| GPFQModel Size=4B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 35.9 | — | — | — | — | — | |
| QronosModel Size=0.6B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 35 | — | — | — | — | — | |
| GPTAQModel Size=1.7B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 34 | — | — | — | — | — | |
| GPFQModel Size=0.6B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 33 | — | — | — | — | — | |
| RTNModel Size=14B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 32.9 | — | — | — | — | — | |
| RTNModel Size=32B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 32.8 | — | — | — | — | — | |
| OPTQModel Size=1.7B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 32.8 | — | — | — | — | — | |
| RTNModel Size=4B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 32.4 | — | — | — | — | — | |
| GPFQModel Size=1.7B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 32.4 | — | — | — | — | — | |
| GPTAQModel Size=0.6B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 32.3 | — | — | — | — | — | |
| RTNModel Size=0.6B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 32.1 | — | — | — | — | — | |
| OPTQModel Size=0.6B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 32 | — | — | — | — | — | |
| RTNModel Size=1.7B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 31.9 | — | — | — | — | — | |
| RTNModel Size=8B, Bits=2-bit, Quantization Transform (Stage 1)=HIP, Backbone=Qwen32025.05 | 31.8 | — | — | — | — | — | |
| AdaSVDRatio=0.4, Backbone=Llama-2-7B, Evaluation Protocol=Zero-shot2026.02 | — | 41.12 | 58.17 | 31.75 | 58.49 | 47.38 | |
| AdaSVDRatio=0.5, Backbone=Llama-2-7B, Evaluation Protocol=Zero-shot2026.02 | — | 34.18 | 54.06 | 28.88 | 55.5 | 43.16 | |
| AdaSVDRatio=0.6, Backbone=Llama-2-7B, Evaluation Protocol=Zero-shot2026.02 | — | 28.2 | 51.22 | 27.36 | 52.83 | 39.9 | |
| ASVDRatio=0.4, Backbone=Llama-2-7B, Evaluation Protocol=Zero-shot2026.02 | — | 26.81 | 49.49 | 25.83 | 53.81 | 38.99 | |
| ASVDRatio=0.5, Backbone=Llama-2-7B, Evaluation Protocol=Zero-shot2026.02 | — | 25.13 | 49.17 | 25.48 | 52.94 | 38.18 | |
| ASVDRatio=0.6, Backbone=Llama-2-7B, Evaluation Protocol=Zero-shot2026.02 | — | 26.68 | 48.86 | 25.76 | 51.8 | 38.28 | |
| FWSVDRatio=0.4, Backbone=Llama-2-7B, Evaluation Protocol=Zero-shot2026.02 | — | 26.05 | 50.2 | 25.7 | 52.39 | 38.59 | |
| FWSVDRatio=0.5, Backbone=Llama-2-7B, Evaluation Protocol=Zero-shot2026.02 | — | 25.84 | 48.7 | 25.64 | 52.83 | 38.25 | |
| FWSVDRatio=0.6, Backbone=Llama-2-7B, Evaluation Protocol=Zero-shot2026.02 | — | 25.38 | 48.46 | 25.61 | 51.96 | 37.85 | |
| OriginalRatio=0, Backbone=Llama-2-7B, Evaluation Protocol=Zero-shot2026.02 | — | 74.62 | 69.22 | 76 | 79.11 | 68.85 | |
| OursRatio=0.4, Backbone=Llama-2-7B, Evaluation Protocol=Zero-shot2026.02 | — | 43.27 | 57.77 | 32.14 | 58.92 | 48.03 | |
| OursRatio=0.5, Backbone=Llama-2-7B, Evaluation Protocol=Zero-shot2026.02 | — | 35.56 | 55.8 | 29.58 | 56.58 | 44.38 | |
| OursRatio=0.6, Backbone=Llama-2-7B, Evaluation Protocol=Zero-shot2026.02 | — | 31.02 | 52.01 | 30.38 | 54.62 | 42.01 | |
| SVDRatio=0.4, Backbone=Llama-2-7B, Evaluation Protocol=Zero-shot2026.02 | — | 26.39 | 48.62 | 25.64 | 52.99 | 38.41 | |
| SVDRatio=0.5, Backbone=Llama-2-7B, Evaluation Protocol=Zero-shot2026.02 | — | 25.8 | 47.36 | 25.55 | 52.67 | 37.85 | |
| SVDRatio=0.6, Backbone=Llama-2-7B, Evaluation Protocol=Zero-shot2026.02 | — | 24.49 | 51.85 | 25.4 | 53.16 | 38.73 | |
| SVD-LLMRatio=0.4, Backbone=Llama-2-7B, Evaluation Protocol=Zero-shot2026.02 | — | 36.99 | 56.04 | 30.49 | 56.96 | 45.12 | |
| SVD-LLMRatio=0.5, Backbone=Llama-2-7B, Evaluation Protocol=Zero-shot2026.02 | — | 31.65 | 51.14 | 28.38 | 54.57 | 41.44 | |
| SVD-LLMRatio=0.6, Backbone=Llama-2-7B, Evaluation Protocol=Zero-shot2026.02 | — | 26.73 | 47.43 | 26.89 | 53.48 | 38.63 |