List your company
ResearchFormerly WizWand

Commonsense Reasoning on ARC-C, ARC-E, PIQA, StoryCloze

55.58Average AccuracyProjQ
35.851240.973146.09551.2169May 30, 2026
Updated 5mo ago

Evaluation results

MethodLinks
ProjQModel Family=LLaMA2, Parameter Scale=13B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0555.58
ProjQModel Family=Qwen2.5-Ins, Parameter Scale=32B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0555.05
CALDERAModel Family=LLaMA2, Parameter Scale=13B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0554.02
LoftQModel Family=LLaMA2, Parameter Scale=13B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0553.82
LoftQModel Family=Qwen2.5-Ins, Parameter Scale=32B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0553.42
GPTQ+SVD-LLMModel Family=LLaMA2, Parameter Scale=13B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0552.97
GPTQ+SVD-LLMModel Family=Qwen2.5-Ins, Parameter Scale=32B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0549.77
ProjQModel Family=LLaMA2, Parameter Scale=7B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0547.82
CALDERAModel Family=Qwen2.5-Ins, Parameter Scale=14B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0547.78
ProjQModel Family=Qwen2.5-Ins, Parameter Scale=14B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0547.68
ProjQModel Family=Qwen3, Parameter Scale=32B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0547.23
CALDERAModel Family=LLaMA2, Parameter Scale=7B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0546.85
GPTQ+SVD-LLMModel Family=Qwen2.5-Ins, Parameter Scale=14B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0546.28
LoftQModel Family=Qwen2.5-Ins, Parameter Scale=14B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0546.1
GPTQ+SVD-LLMModel Family=LLaMA2, Parameter Scale=7B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0545.33
LoftQModel Family=LLaMA2, Parameter Scale=7B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0545.19
LoftQModel Family=Qwen3, Parameter Scale=32B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0544.88
ProjQModel Family=Qwen2.5-Ins, Parameter Scale=7B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0544.44
GPTQ+SVD-LLMModel Family=Qwen3, Parameter Scale=32B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0544.09
LoftQModel Family=Qwen2.5-Ins, Parameter Scale=7B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0543.9
CALDERAModel Family=Qwen2.5-Ins, Parameter Scale=7B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0542.5
ProjQModel Family=Qwen3, Parameter Scale=8B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0541.96
CALDERAModel Family=Qwen3, Parameter Scale=8B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0541.15
LoftQModel Family=Qwen3, Parameter Scale=8B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0540.98
GPTQ+SVD-LLMModel Family=Qwen2.5-Ins, Parameter Scale=7B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0540.96
GPTQ+SVD-LLMModel Family=Qwen3, Parameter Scale=8B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0539.55
ProjQModel Family=Qwen3, Parameter Scale=4B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0539.28
CALDERAModel Family=Qwen3, Parameter Scale=4B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0538.9
LoftQModel Family=Qwen3, Parameter Scale=4B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0538.81
GPTQ+SVD-LLMModel Family=Qwen3, Parameter Scale=4B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0538.38
AWQ+SVD-LLMModel Family=LLaMA2, Parameter Scale=13B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0537.82
AWQ+SVD-LLMModel Family=Qwen2.5-Ins, Parameter Scale=7B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0537.51
AWQ+SVD-LLMModel Family=Qwen2.5-Ins, Parameter Scale=14B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0536.67
AWQ+SVD-LLMModel Family=LLaMA2, Parameter Scale=7B, Quantization Bit=2-bit, Rank (ra = rd)=64, Zero-shot evaluation protocol=true2026.0536.61