Zero-shot Reasoning and Knowledge on Zero-shot Evaluation Suite (ARC, HellaSwag, MMLU, PIQA, Winogrande)
48.1ARC-C AccCodeQuanthad
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| CodeQuanthadModels=Qwen3-30B-A3B, Bit Width=A8W4, Quantization Granularity=Embedding-wise, Online Hadamard Transform=Enabled2026.04 | 48.1 | 72.5 | 71.9 | 70.2 | 76.6 | 65 | 67.4 | |
| SpinQuanthadModels=Qwen3-30B-A3B, Bit Width=A8W4, Quantization Granularity=Embedding-wise, Online Hadamard Transform=Enabled2026.04 | 47.4 | 71.6 | 66.9 | 67.7 | 76.2 | 61.6 | 65.2 | |
| CodeQuanthadModels=DeepSeek V2-Lite, Bit Width=A8W4, Quantization Granularity=Embedding-wise, Online Hadamard Transform=Enabled2026.04 | 45.7 | 72.6 | 74.2 | 47.2 | 78.7 | 67.6 | 64.3 | |
| DuQuantModels=DeepSeek V2-Lite, Bit Width=A8W4, Quantization Granularity=Embedding-wise, Online Hadamard Transform=Disabled2026.04 | 45.5 | 72.3 | 72.8 | 40.6 | 81.5 | 66.5 | 63.2 | |
| DuQuantModels=Qwen3-30B-A3B, Bit Width=A8W4, Quantization Granularity=Embedding-wise, Online Hadamard Transform=Disabled2026.04 | 45.5 | 75.2 | 60.4 | 68.5 | 77.7 | 62.2 | 64.9 | |
| SpinQuanthadModels=DeepSeek V2-Lite, Bit Width=A8W4, Quantization Granularity=Embedding-wise, Online Hadamard Transform=Enabled2026.04 | 43.1 | 69.6 | 72.6 | 43.2 | 78.1 | 65 | 61.9 |