Zero-shot Evaluation on PiQA, ARC (E+C), Hellaswag, Winogrande, and BoolQ benchmark leaderboard · SOTA2 Research

Zero-shot Evaluation on PiQA, ARC (E+C), Hellaswag, Winogrande, and BoolQ

84.4PiQA Accuracy (Zero-shot)FP16

Evaluation Results

Method	Links
FP162026.04		84.4	86	64.3	85	80.8	85.4	81
FP162026.04		80.9	77.7	53.2	79.2	72.9	81.2	74.2
FP162026.04		80.5	77.5	49.2	79.4	72.3	80.6	73.3
FP162026.04		79	74.5	46.3	76	69	77.7	70.4
Quarot+GPTAQ+Ours2026.04		66.5	44	30.1	48.9	58.9	63.2	51.9
Quarot+GPTAQ2026.04		65.3	47.2	27.3	48.5	57.7	63	51.5
Quarot+GPTAQ+Ours2026.04		63.6	46.4	24.9	40.8	56	61.9	48.9
SpinQ+GPTAQ+Ours2026.04		63.4	48.7	29.1	51.2	56.8	64.1	52.2
SpinQ+GPTAQ+Ours2026.04		62.7	45.4	27.6	42.3	55	62.3	49.2
Quarot+GPTAQ2026.04		62.3	45.6	25.6	41.2	54	62.4	48.5
SpinQ+GPTAQ2026.04		62.3	44.6	27.8	48	55	63.6	50.2
SpinQ+GPTAQ2026.04		62.2	42.3	25.5	40.9	54.7	63.4	48.1
Quarot+GPTQ2026.04		61.6	45.7	27	44	55.8	62.3	49.4
SpinQ+GPTAQ2026.04		61.4	42.3	26.6	40.1	54.7	62.7	47.9
SpinQ+GPTAQ+Ours2026.04		60.6	41.4	28.1	40.8	54.1	62.1	47.9
SpinQ+GPTQ2026.04		59	39.5	24.9	40.3	52.6	61.4	46.3
DuQuant+LWC2026.04		58.7	37.3	24.9	41.5	53.3	62	46.2
Quarot+GPTAQ2026.04		57.5	35.1	23.1	31.9	51.8	60.8	43.3
Quarot+GPTAQ+Ours2026.04		57.4	37	22.2	32.7	50.3	61.1	43.5
SpinQ+GPTQ2026.04		57.1	34.9	23.6	33.2	53.7	61.4	44
Quarot+GPTAQ+Ours2026.04		56	38.5	24.6	35.8	53.5	60.9	44.9
Quarot+GPTAQ2026.04		55.8	37.2	22.3	36.5	50.4	59.3	43.6
Quarot+GPTQ2026.04		55.7	35.2	23.9	32.4	50.6	61.8	43.4
Quarot+GPTQ2026.04		55.4	34.7	20.7	31.4	49.7	44.3	39.4
Quarot+GPTQ2026.04		54.3	30.8	19.5	30.3	50.8	56.6	40.4
SpinQ+GPTQ2026.04		53.7	31	23.8	27.8	51.3	46.7	39
SpinQ+GPTAQ2026.04		52.7	27.4	26	29.9	52.4	49.6	39.6
SpinQ+GPTAQ+Ours2026.04		52.2	26.1	26.4	30.2	52.8	50.8	39.9
SpinQ+GPTQ2026.04		51.5	25.5	25.6	33.1	51.7	57.6	40.8
DuQuant+LWC2026.04		51.3	26.1	25.6	25.5	49.3	37.9	35.6