Infilling on ROCStories Infill 1/5
14.5ROUGE-1MDLM
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| MDLMSize=130M, Tokens=157B2026.07 | 14.5 | 1.6 | 13.3 | 71.9 | |
| DiffuGPT-SSize=127M, Tokens=n/a2026.07 | 14 | 1.5 | 13 | — | |
| ASSDSize=110M, Tokens=45B2026.07 | 13.1 | 1.1 | 12 | — | |
| SEDD-SSize=170M, Tokens=210B2026.07 | 11.6 | 0.8 | 10.7 | — | |
| SW-SetDLM S ≤ 32Size=110M, Tokens=157B2026.07 | 11.6 | 1 | 10.9 | 132 | |
| GPT2-SSize=127M, Tokens=n/a2026.07 | 9.5 | 0.4 | 8.7 | — | |
| BD3LM S = 16Size=110M, Tokens=157B2026.07 | 9.2 | 0.6 | 8.6 | 105.8 | |
| AR TransformerSize=130M, Tokens=157B2026.07 | 8.2 | 0.5 | 7.6 | 159.7 |