List your company
ResearchFormerly WizWand

Language Modeling on Lambada (val)

10.14PerplexityGlauber-UL2-L
7.780423.707739.63555.5623Jun 2, 2025Jul 31, 2025Sep 29, 2025Nov 27, 2025Jan 26, 2026Mar 26, 2026May 25, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Glauber-UL2-LZero-shot=true, Model size=Large, N value=3, Note=upper bound2026.0510.14
GPT-2-LZero-shot=true, Model size=Large2026.0510.87
Glauber-UL2-LZero-shot=true, Model size=Large, N value=1, Note=upper bound2026.0511.25
MDM-Prime-v2zero-shot=true, ℓ=16, variant=*2026.0312.37
GPT-2-MZero-shot=true, Model size=Medium2026.0515.6
Glauber-UL2-MZero-shot=true, Model size=Medium, N value=3, Note=upper bound2026.0517.14
Glauber-UL2-MZero-shot=true, Model size=Medium, N value=1, Note=upper bound2026.0517.89
MDM-Primezero-shot=true, ℓ=42026.0324.44
MDM-Primezero-shot=true, ℓ=82026.0325.23
MDM-Primezero-shot=true, ℓ=62026.0325.8
MDM-Prime-v2zero-shot=true, ℓ=162026.0328.4
MDM-Primezero-shot=true, ℓ=22026.0330.91
MDM-Primezero-shot=true, ℓ=6, variant=*2026.0336.15
ARMzero-shot=true, variant=*2026.0337.52
MDMzero-shot=true, variant=*2026.0340.43
SEDD-MZero-shot=true, Model size=Medium, Note=upper bound2026.0542.77
LoopMDMS (inference-time loop count)=6, Zero-shot protocol=true, Model parameters=170M2026.0544.6
LoopMDMS (inference-time loop count)=12, Zero-shot protocol=true, Model parameters=170M2026.0545.8
DCDMParam=0.1B, Training Tokens=128B, Evaluation Protocol=Zero-shot2026.0546.43
EDLM-NCEzero-shot=true2026.0346.92
MDMzero-shot=true2026.0347.52
MDLMParam=0.1B, Training Tokens=256B, Evaluation Protocol=Zero-shot2026.0548.29
MDMZero-shot protocol=true, Model parameters=170M2026.0549.6
Duozero-shot=true2026.0349.78
SEDDzero-shot=true2026.0349.86
BD3-LMzero-shot=true2026.0350.03
BDLMParam=0.1B, Training Tokens=256B, Evaluation Protocol=Zero-shot2026.0550.03
EDLM-coARzero-shot=true2026.0350.04
BD3-LMTraining steps=250K, Training Dataset=OWT, Zero-shot=true, L'=162025.0650.05
ARMzero-shot=true2026.0351.28
AR TransformerTraining steps=250K, Training Dataset=OWT, Zero-shot=true2025.0651.69
MDLMTraining steps=250K, Training Dataset=OWT, Zero-shot=true2025.0652.06
ARParam=0.1B, Evaluation Protocol=Zero-shot2026.0552.13
SEDD AbsorbTraining steps=250K, Training Dataset=OWT, Zero-shot=true2025.0652.16
LoopMDMS (inference-time loop count)=1, Zero-shot protocol=true, Model parameters=170M2026.0553.3
Eso-LMsTraining steps=250K, Training Dataset=OWT, Zero-shot=true, alpha_0=0.52025.0657.33
Eso-LMsTraining steps=250K, Training Dataset=OWT, Zero-shot=true, alpha_0=0.252025.0660.15
Eso-LMsTraining steps=250K, Training Dataset=OWT, Zero-shot=true, alpha_0=12025.0661.37
Eso-LMsTraining steps=250K, Training Dataset=OWT, Zero-shot=true, alpha_0=0.1252025.0669.13