Language Generation on OpenWebText (test)
14.8GenPPL (Oracle)Data
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Data2026.05 | 14.8 | — | 100 | — | |
| LaDiffCompression=2×, Regularization strategy=MildAug, N_cont=200, N_disc=10242026.05 | 31.4 | 85.1 | 90 | 73 | |
| LaDiffCompression=1×, Regularization strategy=MildAug, N_cont=200, N_disc=10242026.05 | 31.6 | 140.2 | 90 | 14 | |
| LaDiffCompression=4×, Regularization strategy=MildAug, N_cont=200, N_disc=10242026.05 | 38.9 | 93.9 | 89 | 74 | |
| LaDiffCompression=1×, Regularization strategy=Standard, N_cont=200, N_disc=10242026.05 | 40.1 | 68.8 | 90 | 77 | |
| LaDiffCompression=2×, Regularization strategy=Standard, N_cont=200, N_disc=10242026.05 | 41.6 | 62.9 | 87 | 82 | |
| LaDiffCompression=8×, Regularization strategy=MildAug, N_cont=200, N_disc=10242026.05 | 45.9 | 80.2 | 89 | 77 | |
| LaDiffCompression=16×, Regularization strategy=MildAug, N_cont=200, N_disc=10242026.05 | 48.7 | 112.5 | 89 | 80 | |
| LaDiffCompression=32×, Regularization strategy=MildAug, N_cont=200, N_disc=10242026.05 | 61.2 | 120.9 | 86 | 77 | |
| MDLMN_cont=200, N_disc=10242026.05 | — | 90.5 | — | 74 |