Language Modeling on OWT (test)
17.5Perplexity (PPL)CUBOβ=2
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CUBOβ=2L'=4, Regime=AO-ARM2026.05 | 17.5 | — | |
| Exact ARM baseline2026.05 | 17.54 | — | |
| TUBEL'=4, Regime=AO-ARM2026.05 | 17.74 | 0.2 | |
| CUBOβ=2L'=8, Regime=AO-ARM2026.05 | 17.95 | — | |
| CUBOβ=2L'=16, Regime=AO-ARM2026.05 | 18.08 | — | |
| TUBEL'=16, Regime=NFE= 162026.05 | 18.22 | 0.68 | |
| TUBEL'=16, Regime=NFE= 82026.05 | 18.44 | 0.9 | |
| CUBOβ=2L'=16, Regime=NFE= 162026.05 | 18.44 | — | |
| ELBOKL'=4, Regime=AO-ARM2026.05 | 18.46 | — | |
| TUBEL'=16, Regime=AO-ARM2026.05 | 18.47 | 0.93 | |
| TVOUL'=4, Regime=AO-ARM2026.05 | 18.55 | — | |
| TUBEL'=8, Regime=AO-ARM2026.05 | 18.67 | 1.13 | |
| IS-VG-BL'=4, Regime=AO-ARM2026.05 | 18.76 | — | |
| CUBOβ=2L'=8, Regime=NFE= 82026.05 | 18.85 | — | |
| TUBEL'=16, Regime=NFE= 42026.05 | 19.03 | 1.49 | |
| TUBEL'=8, Regime=NFE= 82026.05 | 19.15 | 1.61 | |
| TUBEL'=4, Regime=NFE= 42026.05 | 19.16 | 1.62 | |
| ELBOKL'=8, Regime=AO-ARM2026.05 | 19.24 | — | |
| ELBOKL'=16, Regime=AO-ARM2026.05 | 19.3 | — | |
| TVOUL'=8, Regime=AO-ARM2026.05 | 19.31 | — | |
| TVOUL'=16, Regime=AO-ARM2026.05 | 19.39 | — | |
| IS-VG-BL'=8, Regime=AO-ARM2026.05 | 19.46 | — | |
| IS-VG-BL'=16, Regime=AO-ARM2026.05 | 19.56 | — | |
| CUBOβ=2L'=16, Regime=NFE= 82026.05 | 19.59 | — | |
| CUBOβ=2L'=4, Regime=NFE= 42026.05 | 19.78 | — | |
| ELBOKL'=16, Regime=NFE= 162026.05 | 19.83 | — | |
| TVOUL'=16, Regime=NFE= 162026.05 | 19.98 | — | |
| TUBEL'=8, Regime=NFE= 42026.05 | 20.23 | 2.69 | |
| IS-VG-BL'=16, Regime=NFE= 162026.05 | 20.26 | — | |
| ELBOKL'=8, Regime=NFE= 82026.05 | 20.67 | — | |
| TVOUL'=8, Regime=NFE= 82026.05 | 20.83 | — | |
| CUBOβ=2L'=8, Regime=NFE= 42026.05 | 20.9 | — | |
| ELBOKL'=16, Regime=NFE= 82026.05 | 21.14 | — | |
| IS-VG-BL'=8, Regime=NFE= 82026.05 | 21.17 | — | |
| ELBOL'=4, Regime=AO-ARM2026.05 | 21.36 | — | |
| TVOUL'=16, Regime=NFE= 82026.05 | 21.38 | — | |
| TUBEL'=4, Regime=NFE= 22026.05 | 21.55 | 4.01 | |
| ELBOKL'=4, Regime=NFE= 42026.05 | 21.63 | — | |
| IS-VG-BL'=16, Regime=NFE= 82026.05 | 21.77 | — | |
| TVOUL'=4, Regime=NFE= 42026.05 | 21.89 | — | |
| ELBOL'=8, Regime=AO-ARM2026.05 | 22.18 | — | |
| TUBEL'=16, Regime=NFE= 22026.05 | 22.5 | 4.96 | |
| IS-VG-BL'=4, Regime=NFE= 42026.05 | 22.52 | — | |
| ELBOL'=16, Regime=AO-ARM2026.05 | 22.81 | — | |
| CUBOβ=2L'=16, Regime=NFE= 42026.05 | 22.89 | — | |
| ELBOKL'=8, Regime=NFE= 42026.05 | 23.25 | — | |
| TVOUL'=8, Regime=NFE= 42026.05 | 23.54 | — | |
| IS-VG-BL'=8, Regime=NFE= 42026.05 | 24.15 | — | |
| TUBEL'=8, Regime=NFE= 22026.05 | 24.32 | 6.78 | |
| CUBOβ=2L'=4, Regime=NFE= 22026.05 | 24.34 | — | |
| ELBOKL'=16, Regime=NFE= 42026.05 | 24.75 | — | |
| TVOUL'=16, Regime=NFE= 42026.05 | 25.21 | — | |
| IS-VG-BL'=16, Regime=NFE= 42026.05 | 25.96 | — | |
| ELBOKL'=4, Regime=NFE= 22026.05 | 27.4 | — | |
| TVOUL'=4, Regime=NFE= 22026.05 | 27.68 | — | |
| CUBOβ=2L'=8, Regime=NFE= 22026.05 | 29.04 | — | |
| IS-VG-BL'=4, Regime=NFE= 22026.05 | 29.11 | — | |
| ELBOKL'=8, Regime=NFE= 22026.05 | 32.63 | — | |
| TVOUL'=8, Regime=NFE= 22026.05 | 33.41 | — | |
| IS-VG-BL'=8, Regime=NFE= 22026.05 | 34.95 | — | |
| CUBOβ=2L'=16, Regime=NFE= 22026.05 | 35.8 | — | |
| ELBOKL'=16, Regime=NFE= 22026.05 | 38.43 | — | |
| TVOUL'=16, Regime=NFE= 22026.05 | 39.8 | — | |
| IS-VG-BL'=16, Regime=NFE= 22026.05 | 41.93 | — | |
| CUBOβ=2L'=4, Regime=NFE= 12026.05 | 97.78 | — | |
| TVOUL'=4, Regime=NFE= 12026.05 | 97.78 | — | |
| IS-VG-BL'=4, Regime=NFE= 12026.05 | 97.78 | — | |
| TUBEL'=4, Regime=NFE= 12026.05 | 97.78 | 80.24 | |
| ELBOKL'=4, Regime=NFE= 12026.05 | 97.78 | — | |
| CUBOβ=2L'=8, Regime=NFE= 12026.05 | 221.54 | — | |
| TVOUL'=8, Regime=NFE= 12026.05 | 221.54 | — | |
| IS-VG-BL'=8, Regime=NFE= 12026.05 | 221.54 | — | |
| TUBEL'=8, Regime=NFE= 12026.05 | 221.54 | 204 | |
| ELBOKL'=8, Regime=NFE= 12026.05 | 221.54 | — | |
| CUBOβ=2L'=16, Regime=NFE= 12026.05 | 398.63 | — | |
| TVOUL'=16, Regime=NFE= 12026.05 | 398.63 | — | |
| IS-VG-BL'=16, Regime=NFE= 12026.05 | 398.63 | — | |
| TUBEL'=16, Regime=NFE= 12026.05 | 398.63 | 381.09 | |
| ELBOKL'=16, Regime=NFE= 12026.05 | 398.63 | — |