Zero-shot Reasoning on Qwen3 Evaluation Suite (PIQA, ARC-E, ARC-C, HellaSwag, Winogrande, MMLU)
79.76PIQA Accuracybf16
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| bf16Model=Qwen3-14B, Bit=bf162026.06 | 79.76 | 82.87 | 60.24 | 78.82 | 72.85 | 77.3 | 75.31 | |
| AWQ+KVQuantModel=Qwen3-14B, Bit=w4kv42026.06 | 79.65 | 81.48 | 58.19 | 77.76 | 72.38 | 74.94 | 74.07 | |
| Q-EnhanceModel=Qwen3-14B, Bit=w3.86 kv4.142026.06 | 79.38 | 81.78 | 59.64 | 77.5 | 72.06 | 76.01 | 74.4 | |
| RTNModel=Qwen3-14B, Bit=w4kv42026.06 | 79.33 | 79.92 | 57 | 78.06 | 70.48 | 75.37 | 73.36 | |
| bf16Model=Qwen3-8B, Bit=bf162026.06 | 77.69 | 80.93 | 56.57 | 74.93 | 67.56 | 72.96 | 71.77 | |
| Q-EnhanceModel=Qwen3-8B, Bit=w4.12 kv3.882026.06 | 76.82 | 79.34 | 55.03 | 72.74 | 66.61 | 70.32 | 70.14 | |
| AWQ+KVQuantModel=Qwen3-8B, Bit=w4kv42026.06 | 76.39 | 79.38 | 56.4 | 72.87 | 66.06 | 69.43 | 70.09 | |
| RTNModel=Qwen3-8B, Bit=w4kv42026.06 | 74.65 | 75.84 | 52.65 | 72.93 | 64.88 | 68.64 | 68.27 |