List your company
ResearchFormerly WizWand

Language Modeling on 1BW

21.8PerplexityADEPT
17.115248.737680.36111.9824Jun 6, 2024Oct 1, 2024Jan 27, 2025May 25, 2025Sep 20, 2025Jan 16, 2026May 14, 2026
Updated 5mo ago

Evaluation results

MethodLinks
ADEPTArchitecture=Llama 7B, Reduction=10%2026.0121.8
ADEPTArchitecture=Llama 7B, Reduction=20%2026.0122.7
PABEEArchitecture=Llama 7B, Reduction=20%2026.0126.3
PABEEArchitecture=Llama 7B, Reduction=10%2026.0127
DeeBERTArchitecture=Llama 7B, Reduction=10%2026.0128.5
DeeBERTArchitecture=Llama 7B, Reduction=20%2026.0130.4
Base ModelArchitecture=Llama 7B, Reduction=None2026.0131.6
ADEPTArchitecture=GPT2 XL, Reduction=10%2026.0131.8
ADEPTArchitecture=GPT2 XL, Reduction=20%2026.0133.4
PABEEArchitecture=GPT2 XL, Reduction=10%2026.0134.5
PABEEArchitecture=GPT2 XL, Reduction=20%2026.0134.8
DeeBERTArchitecture=GPT2 XL, Reduction=10%2026.0137.8
DeeBERTArchitecture=GPT2 XL, Reduction=20%2026.0138.9
Base ModelArchitecture=GPT2 XL, Reduction=None2026.0142.2
GPT-2Model Size=medium, Evaluation Protocol=Zero-shot2024.0655.72
RADD-AOModel Size=medium, Evaluation Protocol=Zero-shot, Training Iterations=400k2024.0657.07
RADD-DSEModel Size=medium, Evaluation Protocol=Zero-shot, Training Iterations=400k2024.0657.45
RADD-t-DCEModel Size=medium, Evaluation Protocol=Zero-shot, Training Iterations=400k2024.0657.95
RADD-λ-DCEModel Size=medium, Evaluation Protocol=Zero-shot, Training Iterations=400k2024.0660.32
SEDD-ScaleModel Size=medium, Evaluation Protocol=Zero-shot, Training Iterations=400k2024.0661.19
Manta-LMZero-shot=true, Protocol=ELBO-based proxy, Model parameters=101M2026.0562.55
SEDD-UnscaleModel Size=medium, Evaluation Protocol=Zero-shot, Training Iterations=400k2024.0667.91
MD4Zero-shot=true, Protocol=ELBO-based proxy2026.0568.1
RADD-DSEModel Size=small, Zero-shot=true, Iterations=400k2024.0672.35
RADD-t-DCEModel Size=small, Zero-shot=true, Iterations=400k2024.0672.6
RADD-λ-DCEModel Size=small, Zero-shot=true, Iterations=400k2024.0672.99
RADDZero-shot=true, Protocol=ELBO-based proxy2026.0572.99
RADD-AOModel Size=small, Zero-shot=true, Iterations=400k2024.0674.28
GPT-2Model Size=small, Zero-shot=true2024.0675.2
GPT-2Zero-shot=true2026.0575.2
AO-GPTZero-shot=true2026.0576.73
SEDD-ScaleModel Size=small, Zero-shot=true, Iterations=400k2024.0679.29
SEDDZero-shot=true, Protocol=ELBO-based proxy2026.0579.29
SEDD-UnscaleModel Size=small, Zero-shot=true, Iterations=400k2024.0680.7
PLAIDModel Size=small, Zero-shot=true2024.0691.12
PLAIDZero-shot=true, Protocol=ELBO-based proxy2026.0591.12
SEDD-UniformModel Size=small, Zero-shot=true, Iterations=400k2024.06101.37
D3PMModel Size=small, Zero-shot=true2024.06138.92
D3PMZero-shot=true, Protocol=ELBO-based proxy2026.05138.92