Question Answering on ARC-E and PIQA (test)
81.33AccuracyFP16 Baseline
Evaluation results
| Method | Links | |
|---|---|---|
| FP16 BaselineBits=FP16, Model=Qwen3-14B, Zero-shot=true2025.12 | 81.33 | |
| LPCDBits=4bit, Quantization Algorithm=RTN, Model=Qwen3-14B, Zero-shot=true2025.12 | 79.49 | |
| FP16 BaselineBits=FP16, Model=Qwen3-8B, Zero-shot=true2025.12 | 79.3 | |
| FP16 BaselineBits=FP16, Model=LLaMA3-8B, Zero-shot=true2025.12 | 79.15 | |
| FP16 BaselineBits=FP16, Model=LLaMA2-13B, Zero-shot=true2025.12 | 78.96 | |
| QEPBits=4bit, Quantization Algorithm=RTN, Model=LLaMA2-13B, Zero-shot=true2025.12 | 78.25 | |
| LoaQBits=4bit, Quantization Algorithm=GPTQ, Model=LLaMA2-13B, Zero-shot=true2025.12 | 78.17 | |
| LoaQBits=4bit, Quantization Algorithm=RTN, Model=LLaMA2-13B, Zero-shot=true2025.12 | 78.12 | |
| LoaQBits=4bit, Quantization Algorithm=RTN, Model=LLaMA3-8B, Zero-shot=true2025.12 | 78.12 | |
| LPCDBits=4bit, Quantization Algorithm=GPTQ, Model=LLaMA2-13B, Zero-shot=true2025.12 | 78.1 | |
| LPCDBits=4bit, Quantization Algorithm=RTN, Model=LLaMA2-13B, Zero-shot=true2025.12 | 77.93 | |
| LPCDBits=4bit, Quantization Algorithm=RTN, Model=LLaMA3-8B, Zero-shot=true2025.12 | 77.89 | |
| LPCDBits=4bit, Quantization Algorithm=GPTQ, Model=Qwen3-14B, Zero-shot=true2025.12 | 77.82 | |
| LoaQBits=4bit, Quantization Algorithm=RTN, Model=Qwen3-14B, Zero-shot=true2025.12 | 77.6 | |
| QEPBits=4bit, Quantization Algorithm=GPTQ, Model=LLaMA2-13B, Zero-shot=true2025.12 | 77.41 | |
| LoaQBits=4bit, Quantization Algorithm=GPTQ, Model=Qwen3-14B, Zero-shot=true2025.12 | 77.02 | |
| QEPBits=4bit, Quantization Algorithm=GPTQ, Model=Qwen3-14B, Zero-shot=true2025.12 | 76.95 | |
| FP16 BaselineBits=FP16, Model=LLaMA2-7B, Zero-shot=true2025.12 | 76.82 | |
| LPCDBits=4bit, Quantization Algorithm=GPTQ, Model=Qwen3-8B, Zero-shot=true2025.12 | 76.61 | |
| QEPBits=4bit, Quantization Algorithm=RTN, Model=LLaMA3-8B, Zero-shot=true2025.12 | 76.13 | |
| QEPBits=4bit, Quantization Algorithm=GPTQ, Model=LLaMA3-8B, Zero-shot=true2025.12 | 75.99 | |
| LPCDBits=4bit, Quantization Algorithm=RTN, Model=Qwen3-8B, Zero-shot=true2025.12 | 75.84 | |
| LoaQBits=4bit, Quantization Algorithm=GPTQ, Model=LLaMA3-8B, Zero-shot=true2025.12 | 75.59 | |
| LPCDBits=4bit, Quantization Algorithm=RTN, Model=LLaMA2-7B, Zero-shot=true2025.12 | 75.27 | |
| LPCDBits=4bit, Quantization Algorithm=GPTQ, Model=LLaMA2-7B, Zero-shot=true2025.12 | 75.04 | |
| LoaQBits=4bit, Quantization Algorithm=RTN, Model=LLaMA2-7B, Zero-shot=true2025.12 | 74.71 | |
| QEPBits=4bit, Quantization Algorithm=RTN, Model=LLaMA2-7B, Zero-shot=true2025.12 | 74.67 | |
| LoaQBits=3bit, Quantization Algorithm=GPTQ, Model=LLaMA2-13B, Zero-shot=true2025.12 | 74.62 | |
| LoaQBits=4bit, Quantization Algorithm=GPTQ, Model=LLaMA2-7B, Zero-shot=true2025.12 | 74.56 | |
| LPCDBits=3bit, Quantization Algorithm=RTN, Model=LLaMA2-13B, Zero-shot=true2025.12 | 74.33 | |
| LPCDBits=3bit, Quantization Algorithm=GPTQ, Model=LLaMA2-13B, Zero-shot=true2025.12 | 74.31 | |
| QEPBits=4bit, Quantization Algorithm=GPTQ, Model=LLaMA2-7B, Zero-shot=true2025.12 | 74.28 | |
| QEPBits=3bit, Quantization Algorithm=GPTQ, Model=LLaMA2-13B, Zero-shot=true2025.12 | 73.72 | |
| QEPBits=4bit, Quantization Algorithm=RTN, Model=Qwen3-14B, Zero-shot=true2025.12 | 73.69 | |
| QEPBits=4bit, Quantization Algorithm=GPTQ, Model=Qwen3-8B, Zero-shot=true2025.12 | 71.13 | |
| LPCDBits=4bit, Quantization Algorithm=GPTQ, Model=LLaMA3-8B, Zero-shot=true2025.12 | 70.01 | |
| QEPBits=4bit, Quantization Algorithm=RTN, Model=Qwen3-8B, Zero-shot=true2025.12 | 69.98 | |
| LoaQBits=3bit, Quantization Algorithm=RTN, Model=LLaMA2-13B, Zero-shot=true2025.12 | 69.28 | |
| LPCDBits=3bit, Quantization Algorithm=GPTQ, Model=Qwen3-14B, Zero-shot=true2025.12 | 69.19 | |
| LoaQBits=3bit, Quantization Algorithm=RTN, Model=Qwen3-14B, Zero-shot=true2025.12 | 69.04 | |
| QEPBits=3bit, Quantization Algorithm=GPTQ, Model=LLaMA2-7B, Zero-shot=true2025.12 | 68.81 | |
| QEPBits=3bit, Quantization Algorithm=RTN, Model=LLaMA2-13B, Zero-shot=true2025.12 | 67.57 | |
| LPCDBits=3bit, Quantization Algorithm=GPTQ, Model=LLaMA2-7B, Zero-shot=true2025.12 | 66.02 | |
| LPCDBits=3bit, Quantization Algorithm=RTN, Model=Qwen3-14B, Zero-shot=true2025.12 | 65.6 | |
| QEPBits=3bit, Quantization Algorithm=GPTQ, Model=Qwen3-14B, Zero-shot=true2025.12 | 65.35 | |
| LPCDBits=3bit, Quantization Algorithm=GPTQ, Model=Qwen3-8B, Zero-shot=true2025.12 | 64.93 | |
| LoaQBits=3bit, Quantization Algorithm=GPTQ, Model=Qwen3-8B, Zero-shot=true2025.12 | 63.63 | |
| LoaQBits=4bit, Quantization Algorithm=RTN, Model=Qwen3-8B, Zero-shot=true2025.12 | 63.33 | |
| LPCDBits=3bit, Quantization Algorithm=RTN, Model=Qwen3-8B, Zero-shot=true2025.12 | 62.91 | |
| LPCDBits=3bit, Quantization Algorithm=GPTQ, Model=LLaMA3-8B, Zero-shot=true2025.12 | 62.9 | |
| LoaQBits=3bit, Quantization Algorithm=GPTQ, Model=Qwen3-14B, Zero-shot=true2025.12 | 62.22 | |
| QEPBits=3bit, Quantization Algorithm=RTN, Model=Qwen3-14B, Zero-shot=true2025.12 | 61.64 | |
| LoaQBits=4bit, Quantization Algorithm=GPTQ, Model=Qwen3-8B, Zero-shot=true2025.12 | 60.66 | |
| QEPBits=3bit, Quantization Algorithm=GPTQ, Model=Qwen3-8B, Zero-shot=true2025.12 | 59.86 | |
| QEPBits=3bit, Quantization Algorithm=RTN, Model=LLaMA2-7B, Zero-shot=true2025.12 | 57.84 | |
| LPCDBits=3bit, Quantization Algorithm=RTN, Model=LLaMA2-7B, Zero-shot=true2025.12 | 56.88 | |
| LoaQBits=3bit, Quantization Algorithm=GPTQ, Model=LLaMA3-8B, Zero-shot=true2025.12 | 55.32 | |
| QEPBits=3bit, Quantization Algorithm=RTN, Model=Qwen3-8B, Zero-shot=true2025.12 | 54.42 | |
| QEPBits=3bit, Quantization Algorithm=GPTQ, Model=LLaMA3-8B, Zero-shot=true2025.12 | 54.27 | |
| LPCDBits=3bit, Quantization Algorithm=RTN, Model=LLaMA3-8B, Zero-shot=true2025.12 | 53.73 | |
| LoaQBits=3bit, Quantization Algorithm=RTN, Model=LLaMA3-8B, Zero-shot=true2025.12 | 52.82 | |
| QEPBits=3bit, Quantization Algorithm=RTN, Model=LLaMA3-8B, Zero-shot=true2025.12 | 51.36 | |
| LoaQBits=3bit, Quantization Algorithm=RTN, Model=LLaMA2-7B, Zero-shot=true2025.12 | 47.99 | |
| LoaQBits=3bit, Quantization Algorithm=GPTQ, Model=LLaMA2-7B, Zero-shot=true2025.12 | 45.56 | |
| QEPBits=2bit, Quantization Algorithm=GPTQ, Model=Qwen3-14B, Zero-shot=true2025.12 | 43.55 | |
| LPCDBits=2bit, Quantization Algorithm=GPTQ, Model=Qwen3-14B, Zero-shot=true2025.12 | 43.54 | |
| LoaQBits=2bit, Quantization Algorithm=GPTQ, Model=Qwen3-14B, Zero-shot=true2025.12 | 42.53 | |
| LoaQBits=2bit, Quantization Algorithm=RTN, Model=Qwen3-14B, Zero-shot=true2025.12 | 41.83 | |
| LPCDBits=2bit, Quantization Algorithm=GPTQ, Model=Qwen3-8B, Zero-shot=true2025.12 | 40.54 | |
| LoaQBits=2bit, Quantization Algorithm=GPTQ, Model=Qwen3-8B, Zero-shot=true2025.12 | 40.31 | |
| QEPBits=2bit, Quantization Algorithm=GPTQ, Model=Qwen3-8B, Zero-shot=true2025.12 | 39.72 | |
| LoaQBits=3bit, Quantization Algorithm=RTN, Model=Qwen3-8B, Zero-shot=true2025.12 | 39.71 | |
| LPCDBits=2bit, Quantization Algorithm=GPTQ, Model=LLaMA3-8B, Zero-shot=true2025.12 | 39.62 | |
| QEPBits=2bit, Quantization Algorithm=GPTQ, Model=LLaMA2-7B, Zero-shot=true2025.12 | 39.31 | |
| LoaQBits=2bit, Quantization Algorithm=RTN, Model=Qwen3-8B, Zero-shot=true2025.12 | 39.17 | |
| QEPBits=2bit, Quantization Algorithm=RTN, Model=LLaMA3-8B, Zero-shot=true2025.12 | 39.04 | |
| QEPBits=2bit, Quantization Algorithm=RTN, Model=Qwen3-14B, Zero-shot=true2025.12 | 38.95 | |
| QEPBits=2bit, Quantization Algorithm=GPTQ, Model=LLaMA3-8B, Zero-shot=true2025.12 | 38.89 | |
| LPCDBits=2bit, Quantization Algorithm=RTN, Model=Qwen3-8B, Zero-shot=true2025.12 | 38.64 | |
| LPCDBits=2bit, Quantization Algorithm=RTN, Model=Qwen3-14B, Zero-shot=true2025.12 | 38.64 | |
| LPCDBits=2bit, Quantization Algorithm=GPTQ, Model=LLaMA2-7B, Zero-shot=true2025.12 | 38.56 | |
| QEPBits=2bit, Quantization Algorithm=RTN, Model=Qwen3-8B, Zero-shot=true2025.12 | 38.45 | |
| LoaQBits=2bit, Quantization Algorithm=GPTQ, Model=LLaMA3-8B, Zero-shot=true2025.12 | 38.42 | |
| LoaQBits=2bit, Quantization Algorithm=GPTQ, Model=LLaMA2-13B, Zero-shot=true2025.12 | 38.4 | |
| LoaQBits=2bit, Quantization Algorithm=RTN, Model=LLaMA3-8B, Zero-shot=true2025.12 | 38.36 | |
| QEPBits=2bit, Quantization Algorithm=RTN, Model=LLaMA2-13B, Zero-shot=true2025.12 | 38.31 | |
| LPCDBits=2bit, Quantization Algorithm=RTN, Model=LLaMA3-8B, Zero-shot=true2025.12 | 38.26 | |
| QEPBits=2bit, Quantization Algorithm=GPTQ, Model=LLaMA2-13B, Zero-shot=true2025.12 | 38.21 | |
| LPCDBits=2bit, Quantization Algorithm=GPTQ, Model=LLaMA2-13B, Zero-shot=true2025.12 | 38.17 | |
| QEPBits=2bit, Quantization Algorithm=RTN, Model=LLaMA2-7B, Zero-shot=true2025.12 | 38.16 | |
| LoaQBits=2bit, Quantization Algorithm=RTN, Model=LLaMA2-13B, Zero-shot=true2025.12 | 38.05 | |
| LPCDBits=2bit, Quantization Algorithm=RTN, Model=LLaMA2-13B, Zero-shot=true2025.12 | 37.94 | |
| LoaQBits=2bit, Quantization Algorithm=GPTQ, Model=LLaMA2-7B, Zero-shot=true2025.12 | 37.61 | |
| LoaQBits=2bit, Quantization Algorithm=RTN, Model=LLaMA2-7B, Zero-shot=true2025.12 | 37.58 | |
| LPCDBits=2bit, Quantization Algorithm=RTN, Model=LLaMA2-7B, Zero-shot=true2025.12 | 37.56 |