Byte-level Language Modeling on WikiText-2 (val)
5.083BPBUniMatrix-ROSA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| UniMatrix-ROSAParams=103,8762026.04 | 5.083 | 33.9 | |
| UniMatrix-CoreParams=83,1402026.04 | 5.084 | 33.91 | |
| UniMatrix-DiscoveryParams=115,1842026.04 | 5.112 | 34.58 | |
| TransformerParams=174,8482026.04 | 5.124 | 34.88 |