Text Generation on OpenWebText (MAUVE, Gen PPL, Entropy)
11.312Gen PPLIDLM-MDLM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| IDLM-MDLMBudget=7682026.05 | 11.312 | — | 4.782 | |
| IDLM-MDLMBudget=3842026.05 | 16.843 | — | 5.089 | |
| PRISMN=10242025.10 | 20.2 | 0.51 | 5.25 | |
| PRISMN=5122025.10 | 20.6 | 0.434 | 5.27 | |
| ReMDMN=5122025.10 | 21.1 | 0.35 | 5.21 | |
| PRISMN=2562025.10 | 21.6 | 0.419 | 5.29 | |
| PRISMN=1282025.10 | 23.9 | 0.278 | 5.32 | |
| ReMDMN=10242025.10 | 28.6 | 0.403 | 5.38 | |
| PRISMN=642025.10 | 29.4 | 0.132 | 5.37 | |
| IDLM-MDLMBudget=1922026.05 | 29.659 | — | 5.323 | |
| ReMDMN=2562025.10 | 30.5 | 0.216 | 5.34 | |
| CoFReBudget=768, Components=FP-MDLM + LCONS + 3SR2026.05 | 37.846 | — | 5.142 | |
| ReMDMN=1282025.10 | 42.5 | 0.057 | 5.43 | |
| ReMDM-confN=10242025.10 | 48 | 0.051 | 5.44 | |
| CoFReBudget=384, Components=FP-MDLM + LCONS + 3SR2026.05 | 48.755 | — | 5.283 | |
| MDLMN=10242025.10 | 51.3 | 0.042 | 5.46 | |
| ReMDM-confN=5122025.10 | 52.5 | 0.037 | 5.49 | |
| MDLMN=5122025.10 | 53 | 0.031 | 5.48 | |
| MDLMN=2562025.10 | 55.8 | 0.023 | 5.49 | |
| ReMDMN=642025.10 | 60.4 | 0.016 | 5.51 | |
| MDLMN=1282025.10 | 61.5 | 0.015 | 5.52 | |
| CoFReBudget=192, Components=FP-MDLM + LCONS + 3SR2026.05 | 65.182 | — | 5.38 | |
| ReMDM-confN=2562025.10 | 66 | 0.022 | 5.54 | |
| PGM 6/6 + SDTTBudget=7682026.05 | 66.316 | — | 5.484 | |
| IDLM-MDLMBudget=962026.05 | 69.165 | — | 5.529 | |
| MDLMN=642025.10 | 72.1 | 0.011 | 5.55 | |
| ReMDM-confN=1282025.10 | 74.2 | 0.015 | 5.57 | |
| PGM 6/6 + SDTTBudget=3842026.05 | 83.952 | — | 5.524 | |
| ReMDM-confN=642025.10 | 90.3 | 0.009 | 5.6 | |
| CoFReBudget=96, Components=FP-MDLM + LCONS + 3SR2026.05 | 101.791 | — | 5.434 | |
| MDLMT=10242026.05 | 105.07 | 0.0082 | 5.635 | |
| MDLMT=5122026.05 | 106.93 | 0.0077 | 5.64 | |
| MDLMT=2562026.05 | 112.2 | 0.0076 | 5.653 | |
| MDLMT=1282026.05 | 121.67 | 0.0075 | 5.669 | |
| PGM 6/6 + SDTTBudget=1922026.05 | 126.604 | — | 5.561 | |
| PGM 6/6Budget=7682026.05 | 132.786 | — | 5.688 | |
| ReMDM-LoopT=2562026.05 | 135.31 | 0.007 | 5.71 | |
| ReMDM-LoopT=5122026.05 | 141.15 | 0.0079 | 5.719 | |
| MDLMT=642026.05 | 143.3 | 0.0056 | 5.697 | |
| ReMDM-LoopT=1282026.05 | 148.71 | 0.0062 | 5.722 | |
| ReMDM-CapT=1282026.05 | 160.28 | 0.006 | 5.728 | |
| ReMDM-CapT=642026.05 | 172.19 | 0.0057 | 5.734 | |
| ReMDM-LoopT=10242026.05 | 175.02 | 0.0071 | 5.758 | |
| ReMDM-CapT=2562026.05 | 175.44 | 0.0064 | 5.749 | |
| PGM 6/6Budget=3842026.05 | 179.928 | — | 5.732 | |
| MDLMT=322026.05 | 196.63 | 0.005 | 5.738 | |
| ReMDM-LoopT=642026.05 | 198.74 | 0.005 | 5.758 | |
| ReMDM-CapT=322026.05 | 224.55 | 0.0049 | 5.762 | |
| ReMDM-CapT=5122026.05 | 226.54 | 0.0062 | 5.797 | |
| PGM 6/6 + SDTTBudget=962026.05 | 249.076 | — | 5.599 | |
| PGM 6/6Budget=1922026.05 | 312.812 | — | 5.785 | |
| ReMDM-LoopT=322026.05 | 349.25 | 0.0045 | 5.814 | |
| ReMDM-CapT=10242026.05 | 356.62 | 0.0063 | 5.875 | |
| PGM 6/6Budget=962026.05 | 693.513 | — | 5.843 |