ResearchBenchmarksLarge Language Model Evaluation on LLaMA 1B 3.2Follow9.75Perplexity (PPL)baseline-6,109.8635,197.507576,504.875117,812.2425Mar 9, 2026Evaluation ResultsMethodMethodLinksPerplexity (PPL)Zero-Shot PerformanceMMLU Scorebaseline#Bits=FP16#Bits=FP162026.039.7554.8236.76SERQ#Bits=W4A4#Bits=W4A42026.0312.5250.4426.34QuaRot#Bits=W4A4#Bits=W4A42026.0313.1750.0326.64SpinQuant#Bits=W4A4#Bits=W4A42026.0313.4748.9526.38SmoothQ(g128)#Bits=W4A4#Bits=W4A42026.0369.2240.0424.43SmoothQ#Bits=W4A4#Bits=W4A42026.03153,00035.5924.37