List your company
ResearchFormerly WizWand

Language Modeling on WikiText-2 2017 (test)

7.5PPL (Uniform)FP16
7.24328.976610.7112.4434Apr 22, 2026
Updated 5mo ago

Evaluation results

MethodLinks
FP16Model=Qwen3-32B2026.047.5———
UniformModel=Qwen3-32B, Average bit-width (b_bar)=4.5, Bit-width range (b_min/b_max)=3/62026.047.52——0.02
UniformModel=Qwen3-32B, Average bit-width (b_bar)=4.0, Bit-width range (b_min/b_max)=3/62026.047.53——0.03
UniformModel=Qwen3-32B, Average bit-width (b_bar)=3.5, Bit-width range (b_min/b_max)=3/52026.047.7——0.2
FP16Model=Qwen3-8B2026.049.53———
UniformModel=Qwen3-8B, Average bit-width (b_bar)=4.5, Bit-width range (b_min/b_max)=3/62026.049.61——0.08
UniformModel=Qwen3-8B, Average bit-width (b_bar)=4.0, Bit-width range (b_min/b_max)=3/62026.049.94——0.41
UniformModel=Qwen3-8B, Average bit-width (b_bar)=3.5, Bit-width range (b_min/b_max)=3/52026.0410——0.47
FP16Model=Qwen3-4B2026.0413.19———
UniformModel=Qwen3-4B, Average bit-width (b_bar)=4.5, Bit-width range (b_min/b_max)=3/62026.0413.42——0.23
UniformModel=Qwen3-4B, Average bit-width (b_bar)=3.5, Bit-width range (b_min/b_max)=3/52026.0413.89——0.7
UniformModel=Qwen3-4B, Average bit-width (b_bar)=4.0, Bit-width range (b_min/b_max)=3/62026.0413.92——0.73
RATEQUANTModel=Qwen3-4B, Average bit-width (b_bar)=3.5, Bit-width range (b_min/b_max)=3/52026.04—13.70.2—
RATEQUANTModel=Qwen3-4B, Average bit-width (b_bar)=4.0, Bit-width range (b_min/b_max)=3/62026.04—13.470.45—
RATEQUANTModel=Qwen3-4B, Average bit-width (b_bar)=4.5, Bit-width range (b_min/b_max)=3/62026.04—13.470.05—
RATEQUANTModel=Qwen3-8B, Average bit-width (b_bar)=3.5, Bit-width range (b_min/b_max)=3/52026.04—9.760.24—
RATEQUANTModel=Qwen3-8B, Average bit-width (b_bar)=4.0, Bit-width range (b_min/b_max)=3/62026.04—9.670.27—
RATEQUANTModel=Qwen3-8B, Average bit-width (b_bar)=4.5, Bit-width range (b_min/b_max)=3/62026.04—9.590.02—
RATEQUANTModel=Qwen3-32B, Average bit-width (b_bar)=3.5, Bit-width range (b_min/b_max)=3/52026.04—7.640.06—
RATEQUANTModel=Qwen3-32B, Average bit-width (b_bar)=4.0, Bit-width range (b_min/b_max)=3/62026.04—7.50.03—
RATEQUANTModel=Qwen3-32B, Average bit-width (b_bar)=4.5, Bit-width range (b_min/b_max)=3/62026.04—7.50.02—