Text Compression on Wiki-40B 6160MB
971Description Length (MB)R-L1
Evaluation Results
| Method | Links | |
|---|---|---|
| R-L1Number of parameters=308M, Regularization type=R-L1, Coding scheme=Arithmetic coding, Chunk size=512 bytes2025.05 | 971 | |
| DRRNumber of parameters=308M, Regularization type=DRR, Coding scheme=Arithmetic coding, Chunk size=512 bytes2025.05 | 973 | |
| UT25Number of parameters=25M, Regularization type=unregularized, Coding scheme=Arithmetic coding, Chunk size=512 bytes2025.05 | 1,080 | |
| UT4Number of parameters=4M, Regularization type=unregularized, Coding scheme=Arithmetic coding, Chunk size=512 bytes2025.05 | 1,130 | |
| PMMPNumber of parameters=308M, Regularization type=PMMP, Coding scheme=Arithmetic coding, Chunk size=512 bytes2025.05 | 1,220 | |
| UT308Number of parameters=308M, Regularization type=unregularized, Coding scheme=Arithmetic coding, Chunk size=512 bytes2025.05 | 2,060 | |
| ZSTDtype=conventional compressor2025.05 | 4,010 | |
| LZMA2type=conventional compressor2025.05 | 4,958 |