List your company
ResearchFormerly WizWand

Language Modeling on WikiText-2, PTB3, and WikiText-103

4.645Perplexity (WikiText-2)SASQ
-13.11016106.73717226.5845346.43183Dec 16, 2025
Updated 8mo ago

Evaluation results

MethodLinks
SASQModel=LLaMA2-13B2025.124.64513.5365.0527.744
BaselineModel=LLaMA2-13B, Precision=FP162025.124.88436.6217.09916.201
QuaRotModel=LLaMA2-13B2025.124.936.757.11316.254
SMQ DynamicModel=LLaMA2-13B2025.124.92737.7387.20416.623
AWQModel=LLaMA2-13B2025.124.97———
SASQModel=LLaMA1-7B2025.125.1829.0735.1916.482
SASQModel=LLaMA2-7B2025.125.21412.5815.4927.762
BaselineModel=LLaMA2-7B, Precision=FP162025.125.47327.786.78313.345
QuaRotModel=LLaMA2-7B2025.125.524.9986.76812.421
SMQ DynamicModel=LLaMA2-7B2025.125.5127.9946.82813.444
AWQModel=LLaMA2-7B2025.125.6———
BaselineModel=LLaMA1-7B, Precision=FP162025.125.6838.5765.7626.674
SpinQuantModel=LLaMA2-7B2025.125.7———
SMQ DynamicModel=LLaMA1-7B2025.125.7168.625.7966.711
AWQModel=LLaMA1-7B2025.125.78———
SASQModel=LLaMA3-8B2025.126.12410.5536.1357.604
BaselineModel=LLaMA3-8B, Precision=FP162025.126.149.9926.2597.464
SMQ DynamicModel=LLaMA3-8B2025.126.24310.1286.3657.579
SpinQuantModel=LLaMA3-8B2025.126.5———
SASQModel=Qwen2.5-7B2025.126.52612.9576.4398.641
BaselineModel=Qwen2.5-7B, Precision=FP162025.126.8511.2866.8788.338
SMQ DynamicModel=Qwen2.5-7B2025.126.99411.5037.0138.503
LLM-QATModel=LLaMA3-8B2025.127.7———
SASQModel=Qwen2.5-1.5B2025.128.46516.928.22711.204
BaselineModel=Qwen2.5-1.5B, Precision=FP162025.129.2715.4299.14911.283
SMQ DynamicModel=Qwen2.5-1.5B2025.129.42515.6939.28311.467
LLM-QATModel=LLaMA1-7B2025.1210.3———
LLM-QATModel=LLaMA2-7B2025.1211.4———
LLM-QATModel=LLaMA2-13B2025.1214.5———
SMQ StaticModel=LLaMA2-7B2025.12448.524863.796387.995566.772