List your company

Zero-shot Reasoning on Reasoning Suite (PIQA, ARC, BoolQ, Winogrande)

83.68PIQA AccuracyFP16
78.864880.114981.36582.6151May 21, 2026

Evaluation results

MethodLinks
FP16#Bits=16-162026.0583.6883.4259.7385.0576.3277.64
FP16*#Bits=16-162026.0583.4183.2955.884.5675.8576.58
GEMQ#Bits=3-162026.0582.5480.6857.3485.0274.976.1
GEMQ#Bits=2.5-162026.0581.0775.9351.7980.0973.7272.52
EAQuant*#Bits=3-42026.0579.0578.4550.6878.6969.371.23