Winograd Schema Challenge on WinoGrande
76.56AccuracyGPTAQ
Evaluation Results
| Method | Links | |
|---|---|---|
| GPTAQModel=LLaMA-30B, Precision=W4A16, Zero-shot=true2026.05 | 76.56 | |
| AWQModel=LLaMA-30B, Precision=W4A16, Zero-shot=true2026.05 | 76.4 | |
| GPTQModel=LLaMA-30B, Precision=W4A16, Zero-shot=true2026.05 | 76.24 | |
| SARQC-GS(Saliency)Model=LLaMA-30B, Precision=W4A16, Zero-shot=true2026.05 | 76.24 | |
| FP16Model=LLaMA-30B, Precision=W4A16, Zero-shot=true2026.05 | 75.93 | |
| SARQC-GS(Identity)Model=LLaMA-30B, Precision=W4A16, Zero-shot=true2026.05 | 75.93 | |
| FP16Model=LLaMA-30B, Precision=W3A16, Zero-shot=true2026.05 | 75.93 | |
| SARQC-GBS(Saliency)Model=LLaMA-30B, Precision=W4A16, Zero-shot=true2026.05 | 75.45 | |
| SARQC-GBS(Identity)Model=LLaMA-30B, Precision=W4A16, Zero-shot=true2026.05 | 75.37 | |
| SARQC-GBS(Identity)Model=LLaMA-30B, Precision=W3A16, Zero-shot=true2026.05 | 75.06 | |
| SARQC-GBS(Saliency)Model=LLaMA-30B, Precision=W3A16, Zero-shot=true2026.05 | 74.74 | |
| GPTAQModel=LLaMA-30B, Precision=W3A16, Zero-shot=true2026.05 | 73.88 | |
| FP16Model=LLaMA-13B, Precision=W4A16, Zero-shot=true2026.05 | 73.56 | |
| FP16Model=LLaMA-13B, Precision=W3A16, Zero-shot=true2026.05 | 73.56 | |
| GPTQModel=LLaMA-30B, Precision=W3A16, Zero-shot=true2026.05 | 73.09 | |
| SARQC-GS(Saliency)Model=LLaMA-13B, Precision=W4A16, Zero-shot=true2026.05 | 72.85 | |
| SARQC-GBS(Saliency)Model=LLaMA-13B, Precision=W4A16, Zero-shot=true2026.05 | 72.53 | |
| AWQModel=LLaMA-13B, Precision=W4A16, Zero-shot=true2026.05 | 72.22 | |
| SARQC-GS(Identity)Model=LLaMA-13B, Precision=W4A16, Zero-shot=true2026.05 | 71.74 | |
| SARQC-GBS(Identity)Model=LLaMA-13B, Precision=W4A16, Zero-shot=true2026.05 | 71.67 | |
| GPTAQModel=LLaMA-13B, Precision=W4A16, Zero-shot=true2026.05 | 71.43 | |
| SARQC-GBS(Identity)Model=LLaMA-13B, Precision=W3A16, Zero-shot=true2026.05 | 71.43 | |
| GPTQModel=LLaMA-13B, Precision=W4A16, Zero-shot=true2026.05 | 71.27 | |
| SARQC-GBS(Saliency)Model=LLaMA-13B, Precision=W3A16, Zero-shot=true2026.05 | 70.88 | |
| FP16Model=LLaMA-7B, Precision=W4A16, Zero-shot=true2026.05 | 70.17 | |
| FP16Model=LLaMA-7B, Precision=W3A16, Zero-shot=true2026.05 | 70.17 | |
| GPTAQModel=LLaMA-13B, Precision=W3A16, Zero-shot=true2026.05 | 70.09 | |
| SARQC-GBS(Saliency)Model=LLaMA-7B, Precision=W4A16, Zero-shot=true2026.05 | 69.77 | |
| GPTQModel=LLaMA-13B, Precision=W3A16, Zero-shot=true2026.05 | 69.69 | |
| SARQC-GS(Saliency)Model=LLaMA-7B, Precision=W4A16, Zero-shot=true2026.05 | 69.38 | |
| AWQModel=LLaMA-7B, Precision=W4A16, Zero-shot=true2026.05 | 68.82 | |
| SARQC-GS(Identity)Model=LLaMA-7B, Precision=W4A16, Zero-shot=true2026.05 | 68.59 | |
| GPTQModel=LLaMA-7B, Precision=W4A16, Zero-shot=true2026.05 | 68.51 | |
| SARQC-GBS(Identity)Model=LLaMA-7B, Precision=W4A16, Zero-shot=true2026.05 | 68.35 | |
| GPTAQModel=LLaMA-7B, Precision=W4A16, Zero-shot=true2026.05 | 68.19 | |
| GPTAQModel=LLaMA-7B, Precision=W3A16, Zero-shot=true2026.05 | 67.88 | |
| SARQC-GBS(Saliency)Model=LLaMA-7B, Precision=W3A16, Zero-shot=true2026.05 | 67.64 | |
| SARQC-GBS(Identity)Model=LLaMA-7B, Precision=W3A16, Zero-shot=true2026.05 | 67.17 | |
| GPTQModel=LLaMA-7B, Precision=W3A16, Zero-shot=true2026.05 | 65.11 |