Reasoning on GSM8K, MATH-500, AIME24, AIME25, GPQA-D

95.15GSM8K AccuracyBF16

Evaluation results

Method
BF162026.03	95.15	96.87	71.46	63.12	58.13	76.95	100
SmoothQuant2026.03	94.92	96.27	65.62	56.04	54.8	73.53	94.8
BATQuant2026.03	94.84	96.4	68.33	59.38	57.22	75.23	97.46
BATQuant2026.03	94.77	95.6	62.08	52.92	54.19	71.91	92.45
BATQuant2026.03	94.77	95.27	66.04	54.48	54.24	72.96	94
SpinQuant2026.03	94.69	95.53	60.42	51.46	54.58	71.34	91.62
SmoothQuant2026.03	94.69	95.33	60.71	47.29	52.42	70.09	89.6
BRQ2026.03	94.69	95.33	63.75	52.71	54.04	72.1	92.72
FlatQuant2026.03	94.62	95.93	69.17	57.08	54.8	74.32	95.99
BATQuant2026.03	94.62	96.27	69.37	55.21	56.82	74.46	96.22
FlatQuant2026.03	94.54	96	65.42	53.96	54.55	72.89	93.87
QuaRot2026.03	94.47	95.67	64.17	55.63	54.39	72.87	93.91
SpinQuant2026.03	94.47	95.47	59.38	53.96	55.86	71.87	92.56
GPTQ2026.03	94.47	96.13	65	57.08	53.94	73.32	94.54
GPTQ2026.03	94.39	96.33	68.02	59.38	55.1	74.64	96.54
SmoothQuant2026.03	94.39	96.13	66.04	54.79	54.29	73.13	94.21
GPTQ2026.03	94.24	95.73	57.5	52.08	52.12	70.33	90.1
QuaRot2026.03	94.09	92.47	47.5	39.37	48.13	64.31	81.2
QuaRot2026.03	94.09	95.73	64.79	55.83	54.49	72.99	94.11
FlatQuant2026.03	94.09	95.4	63.33	53.54	54.95	72.26	93.07
QuaRot2026.03	94.01	94.8	62.08	52.5	51.82	71.04	91.17
RTN2026.03	93.78	95	60.21	54.79	53.54	71.46	91.96
RTN2026.03	93.71	95.53	64.58	55	54.39	72.64	93.64
BRQ2026.03	93.71	95.8	63.96	53.33	55.4	72.39	93.26
BRQ2026.03	93.56	95.13	62.08	49.17	53.54	70.7	90.68
SpinQuant2026.03	93.4	91.67	38.57	35.63	45.66	60.99	76.35
FlatQuant2026.03	93.4	94.33	58.96	43.54	50.51	68.15	86.78
GPTQ2026.03	93.4	93.07	47.92	39.58	49.75	64.74	81.92
SpinQuant2026.03	93.25	94.33	57.71	49.58	52.12	69.4	88.87
RTN2026.03	93.1	94.53	53.33	47.08	49.8	67.57	86.06
SmoothQuant2026.03	93.03	92.73	46.67	40.33	49.19	63.39	81.46
BRQ2026.03	92.27	91.73	37.29	34.58	48.03	60.78	76.25
RTN2026.03	92.12	91.13	43.54	38.75	46.97	62.5	78.8