Zero-shot Classification on ARC-Challenge, ARC-Easy, PIQA, and WinoGrande
73.9AccuracyFull-precision
Evaluation Results
| Method | Links | |
|---|---|---|
| Full-precisionModel=Qwen3-14B, Quantization setting=FP2026.03 | 73.9 | |
| JointQModel=Qwen3-14B, Quantization setting=4b/1282026.03 | 73.9 | |
| GPTQModel=Qwen3-14B, Quantization setting=4b/1282026.03 | 73.6 | |
| JointQModel=Qwen3-14B, Quantization setting=4b/ch2026.03 | 72.3 | |
| GPTQModel=Qwen3-14B, Quantization setting=4b/ch2026.03 | 72 | |
| Full-precisionModel=Llama-3-8B, Quantization setting=FP2026.03 | 71.5 | |
| Full-precisionModel=Qwen3-8B, Quantization setting=FP2026.03 | 70.7 | |
| JointQModel=Llama-3-8B, Quantization setting=4b/1282026.03 | 70.5 | |
| JointQModel=Qwen3-14B, Quantization setting=3b/1282026.03 | 70.1 | |
| GPTQModel=Qwen3-14B, Quantization setting=3b/1282026.03 | 69.8 | |
| GPTQModel=Llama-3-8B, Quantization setting=4b/1282026.03 | 69.7 | |
| GPTQModel=Qwen3-8B, Quantization setting=4b/1282026.03 | 69.7 | |
| JointQModel=Qwen3-8B, Quantization setting=4b/1282026.03 | 69.5 | |
| JointQModel=Llama-3-8B, Quantization setting=4b/ch2026.03 | 67.6 | |
| GPTQModel=Qwen3-8B, Quantization setting=4b/ch2026.03 | 67.2 | |
| JointQModel=Qwen3-8B, Quantization setting=3b/1282026.03 | 66.8 | |
| JointQModel=Qwen3-8B, Quantization setting=4b/ch2026.03 | 66 | |
| GPTQModel=Qwen3-8B, Quantization setting=3b/1282026.03 | 65.4 | |
| JointQModel=Qwen3-14B, Quantization setting=3b/ch2026.03 | 65.1 | |
| JointQModel=Llama-3-8B, Quantization setting=3b/1282026.03 | 65 | |
| JointQModel=Llama-3-8B, Quantization setting=3b/ch2026.03 | 58.3 | |
| GPTQModel=Qwen3-14B, Quantization setting=3b/ch2026.03 | 58.1 | |
| GPTQModel=Llama-3-8B, Quantization setting=4b/ch2026.03 | 53.3 | |
| GPTQModel=Llama-3-8B, Quantization setting=3b/1282026.03 | 52.1 | |
| JointQModel=Qwen3-8B, Quantization setting=3b/ch2026.03 | 50.6 | |
| GPTQModel=Qwen3-8B, Quantization setting=3b/ch2026.03 | 49.6 | |
| GPTQModel=Llama-3-8B, Quantization setting=3b/ch2026.03 | 38.6 |