Zero-shot Evaluation on ARC-C, ARC-E, BoolQ, and HellaSwag
69.48AccuracyGPTQ
Evaluation Results
| Method | Links | |
|---|---|---|
| GPTQBits=4, Backbone=Qwen3-8B-Base, Zero-shot=true2026.05 | 69.48 | |
| LAQuantBits=3, Backbone=Qwen3-8B-Base, Zero-shot=true2026.05 | 69.35 | |
| ParoQuantBits=4, Backbone=Qwen3-8B-Base, Zero-shot=true2026.05 | 69.32 | |
| LAQuantBits=4, Backbone=Qwen3-8B-Base, Zero-shot=true2026.05 | 69.32 | |
| FP16Bits=16, Backbone=Qwen3-8B-Base, Zero-shot=true2026.05 | 68.95 | |
| FP16Bits=16, Backbone=Llama3.1-8B, Zero-shot=true2026.05 | 68.68 | |
| ParoQuantBits=3, Backbone=Qwen3-8B-Base, Zero-shot=true2026.05 | 68.61 | |
| LAQuantBits=4, Backbone=Llama3.1-8B, Zero-shot=true2026.05 | 68.36 | |
| GPTQBits=4, Backbone=Llama3.1-8B, Zero-shot=true2026.05 | 68.25 | |
| ParoQuantBits=4, Backbone=Llama3.1-8B, Zero-shot=true2026.05 | 68.12 | |
| ParoQuantBits=4, Backbone=Qwen3-4B-Base, Zero-shot=true2026.05 | 67.36 | |
| GPTQBits=3, Backbone=Qwen3-8B-Base, Zero-shot=true2026.05 | 67.34 | |
| LAQuantBits=4, Backbone=Qwen3-4B-Base, Zero-shot=true2026.05 | 66.44 | |
| FP16Bits=16, Backbone=Qwen3-4B-Base, Zero-shot=true2026.05 | 66.28 | |
| ParoQuantBits=3, Backbone=Qwen3-4B-Base, Zero-shot=true2026.05 | 66.01 | |
| GPTQBits=4, Backbone=Qwen3-4B-Base, Zero-shot=true2026.05 | 65.79 | |
| LAQuantBits=3, Backbone=Llama3.1-8B, Zero-shot=true2026.05 | 65.64 | |
| ParoQuantBits=3, Backbone=Llama3.1-8B, Zero-shot=true2026.05 | 65.51 | |
| LAQuantBits=3, Backbone=Qwen3-4B-Base, Zero-shot=true2026.05 | 65.39 | |
| GPTQBits=3, Backbone=Llama3.1-8B, Zero-shot=true2026.05 | 63.08 | |
| ParoQuantBits=4, Backbone=Qwen3-1.7B-Base, Zero-shot=true2026.05 | 60.75 | |
| LAQuantBits=4, Backbone=Qwen3-1.7B-Base, Zero-shot=true2026.05 | 60.2 | |
| GPTQBits=3, Backbone=Qwen3-4B-Base, Zero-shot=true2026.05 | 60.11 | |
| FP16Bits=16, Backbone=Qwen3-1.7B-Base, Zero-shot=true2026.05 | 59.95 | |
| GPTQBits=4, Backbone=Qwen3-1.7B-Base, Zero-shot=true2026.05 | 58.95 | |
| LAQuantBits=3, Backbone=Qwen3-1.7B-Base, Zero-shot=true2026.05 | 58.61 | |
| ParoQuantBits=3, Backbone=Qwen3-1.7B-Base, Zero-shot=true2026.05 | 58.53 | |
| GPTQBits=3, Backbone=Qwen3-1.7B-Base, Zero-shot=true2026.05 | 51.72 |