Zero-shot Downstream Tasks on ARC-C, ARC-E, HellaSwag, PIQA, and WinoGrande
74.35Downstream AverageFP16
Evaluation Results
| Method | Links | |
|---|---|---|
| FP16Model=LLaMA-3.1-8B, Setting=FP162026.06 | 74.35 | |
| FP16Model=LLaMA-2-7B, Setting=FP162026.06 | 68.66 | |
| SYM-INTModel=LLaMA-2-7B, Setting=W3A4 (GPTQ)2026.06 | 62 | |
| Qift-MNZModel=LLaMA-2-7B, Setting=L=16 (GPTAQ)2026.06 | 61.57 | |
| SYM-INTModel=LLaMA-3.1-8B, Setting=W3A4 (GPTQ)2026.06 | 59.72 | |
| Qift-MNZModel=LLaMA-3.1-8B, Setting=L=16 (GPTAQ)2026.06 | 56.09 | |
| Qift-MNZModel=LLaMA-2-7B, Setting=Pure W2A4 (GPTAQ)2026.06 | 47.94 | |
| SYM-INTModel=LLaMA-2-7B, Setting=Pure W2A4 (GPTAQ)2026.06 | 42.11 | |
| Qift-MNZModel=LLaMA-3.1-8B, Setting=Pure W2A4 (GPTAQ)2026.06 | 40.64 | |
| SYM-INTModel=LLaMA-3.1-8B, Setting=Pure W2A4 (GPTAQ)2026.06 | 36.83 |