List your company
ResearchFormerly WizWand

Zero-shot Evaluation on ARC-C, ARC-E, BoolQ, and HellaSwag

69.48AccuracyGPTQ
51.009655.804860.665.3952May 9, 2026
Updated 5mo ago

Evaluation results

MethodLinks
GPTQBits=4, Backbone=Qwen3-8B-Base, Zero-shot=true2026.0569.48
LAQuantBits=3, Backbone=Qwen3-8B-Base, Zero-shot=true2026.0569.35
ParoQuantBits=4, Backbone=Qwen3-8B-Base, Zero-shot=true2026.0569.32
LAQuantBits=4, Backbone=Qwen3-8B-Base, Zero-shot=true2026.0569.32
FP16Bits=16, Backbone=Qwen3-8B-Base, Zero-shot=true2026.0568.95
FP16Bits=16, Backbone=Llama3.1-8B, Zero-shot=true2026.0568.68
ParoQuantBits=3, Backbone=Qwen3-8B-Base, Zero-shot=true2026.0568.61
LAQuantBits=4, Backbone=Llama3.1-8B, Zero-shot=true2026.0568.36
GPTQBits=4, Backbone=Llama3.1-8B, Zero-shot=true2026.0568.25
ParoQuantBits=4, Backbone=Llama3.1-8B, Zero-shot=true2026.0568.12
ParoQuantBits=4, Backbone=Qwen3-4B-Base, Zero-shot=true2026.0567.36
GPTQBits=3, Backbone=Qwen3-8B-Base, Zero-shot=true2026.0567.34
LAQuantBits=4, Backbone=Qwen3-4B-Base, Zero-shot=true2026.0566.44
FP16Bits=16, Backbone=Qwen3-4B-Base, Zero-shot=true2026.0566.28
ParoQuantBits=3, Backbone=Qwen3-4B-Base, Zero-shot=true2026.0566.01
GPTQBits=4, Backbone=Qwen3-4B-Base, Zero-shot=true2026.0565.79
LAQuantBits=3, Backbone=Llama3.1-8B, Zero-shot=true2026.0565.64
ParoQuantBits=3, Backbone=Llama3.1-8B, Zero-shot=true2026.0565.51
LAQuantBits=3, Backbone=Qwen3-4B-Base, Zero-shot=true2026.0565.39
GPTQBits=3, Backbone=Llama3.1-8B, Zero-shot=true2026.0563.08
ParoQuantBits=4, Backbone=Qwen3-1.7B-Base, Zero-shot=true2026.0560.75
LAQuantBits=4, Backbone=Qwen3-1.7B-Base, Zero-shot=true2026.0560.2
GPTQBits=3, Backbone=Qwen3-4B-Base, Zero-shot=true2026.0560.11
FP16Bits=16, Backbone=Qwen3-1.7B-Base, Zero-shot=true2026.0559.95
GPTQBits=4, Backbone=Qwen3-1.7B-Base, Zero-shot=true2026.0558.95
LAQuantBits=3, Backbone=Qwen3-1.7B-Base, Zero-shot=true2026.0558.61
ParoQuantBits=3, Backbone=Qwen3-1.7B-Base, Zero-shot=true2026.0558.53
GPTQBits=3, Backbone=Qwen3-1.7B-Base, Zero-shot=true2026.0551.72