List your company
ResearchFormerly WizWand

Zero-shot Downstream Tasks on ARC-C, ARC-E, HellaSwag, PIQA, and WinoGrande

74.35Downstream AverageFP16
35.329245.459655.5965.7204Jun 1, 2026
Updated 5mo ago

Evaluation results

MethodLinks
FP16Model=LLaMA-3.1-8B, Setting=FP162026.0674.35
FP16Model=LLaMA-2-7B, Setting=FP162026.0668.66
SYM-INTModel=LLaMA-2-7B, Setting=W3A4 (GPTQ)2026.0662
Qift-MNZModel=LLaMA-2-7B, Setting=L=16 (GPTAQ)2026.0661.57
SYM-INTModel=LLaMA-3.1-8B, Setting=W3A4 (GPTQ)2026.0659.72
Qift-MNZModel=LLaMA-3.1-8B, Setting=L=16 (GPTAQ)2026.0656.09
Qift-MNZModel=LLaMA-2-7B, Setting=Pure W2A4 (GPTAQ)2026.0647.94
SYM-INTModel=LLaMA-2-7B, Setting=Pure W2A4 (GPTAQ)2026.0642.11
Qift-MNZModel=LLaMA-3.1-8B, Setting=Pure W2A4 (GPTAQ)2026.0640.64
SYM-INTModel=LLaMA-3.1-8B, Setting=Pure W2A4 (GPTAQ)2026.0636.83