List your company
ResearchFormerly WizWand

Unconditional Generation on Unconditional Generations 1024

6.8PPL (GPT-NEO)GPT2-XL
5.43614.64323.8533.057May 5, 2026
Updated 5mo ago

Evaluation results

MethodLinks
GPT2-XLSampling Algorithm=top-p, p = 0.8, L = 1024, T = 1024, Total Params=1.6B2026.056.8——
GPT2-LSampling Algorithm=top-p, p = 0.8, L = 1024, T = 1024, Total Params=774M2026.057.4—6.5
Glauber-UL2-LConfiguration=post-SEDD, T=3 × L, i.e., N = 3, Sampling Algorithm=L = 1024, Total Params=898M2026.057.8—6.9
Glauber-UL2-LConfiguration=post-SEDD, T=L, i.e., N = 1, Sampling Algorithm=L = 1024, Total Params=898M2026.059.9—9.5
UL2-LConfiguration=post-SEDD, T=3 × L CAUSAL-GEN, Sampling Algorithm=L = 1024, Total Params=898M2026.0511.5—11.4
GPT2-MSampling Algorithm=top-p, p = 0.8, L = 1024, T = 1024, Total Params=345M2026.0514.512.413
Glauber-UL2-MConfiguration=post-SEDD, T=3 × L, i.e., N = 3, Sampling Algorithm=L = 1024, Total Params=419M2026.0514.913.213.7
UL2-LConfiguration=pre-SEDD CAUSAL-GEN, Sampling Algorithm=L = 1024, Total Params=783M2026.0514.9—14.2
Glauber-UL2-MConfiguration=post-SEDD, T=L, i.e., N = 1, Sampling Algorithm=L = 1024, Total Params=419M2026.0516.617.117.5
PlaidSampling Algorithm=τ = 0.9, L = 1024, T = 4096, Total Params=1.3B2026.0517.919.719.7
GGMSampling Algorithm=top-p, p = 0.8, L = 1024, T = 4096, Total Params=387M2026.051819.519.9
UL2-MConfiguration=post-SEDD, T=3 × L CAUSAL-GEN, Sampling Algorithm=L = 1024, Total Params=419M2026.0519.919.119.6
UL2-MConfiguration=pre-SEDD CAUSAL-GEN, Sampling Algorithm=L = 1024, Total Params=368M2026.0520.421.721.3
SEDD-MSampling Algorithm=L = 1024, T = 2048, Total Params=424M2026.0525.227.328
MDLMSampling Algorithm=L = 1024, T = 1000, Total Params=170M2026.0540.944.245.4