Multitask Language Understanding on MMLU (Normalized PLL score)
4.3Normalized PLL ScoreDual
Evaluation results
| Method | Links | |
|---|---|---|
| DualRepetitions=32, Alpha (α)=3/42025.12 | 4.3 | |
| Masked-DiffusionRepetitions=128, Alpha (α)=0:12025.12 | 2.6 | |
| DualRepetitions=128, Alpha (α)=1/82025.12 | 2.1 | |
| Masked-DiffusionRepetitions=32, Alpha (α)=02025.12 | 1.6 |