Text Compression on Wiki-40B 300MB
61Description Length (MB)DRR
Evaluation Results
| Method | Links | |
|---|---|---|
| DRRNumber of parameters=308M, Regularization type=DRR, Coding scheme=Arithmetic coding, Chunk size=512 bytes2025.05 | 61 | |
| R-L1Number of parameters=308M, Regularization type=R-L1, Coding scheme=Arithmetic coding, Chunk size=512 bytes2025.05 | 61 | |
| UT4Number of parameters=4M, Regularization type=unregularized, Coding scheme=Arithmetic coding, Chunk size=512 bytes2025.05 | 70 | |
| PMMPNumber of parameters=308M, Regularization type=PMMP, Coding scheme=Arithmetic coding, Chunk size=512 bytes2025.05 | 94 | |
| UT25Number of parameters=25M, Regularization type=unregularized, Coding scheme=Arithmetic coding, Chunk size=512 bytes2025.05 | 146 | |
| ZSTDtype=conventional compressor2025.05 | 195 | |
| LZMA2type=conventional compressor2025.05 | 241 | |
| UT308Number of parameters=308M, Regularization type=unregularized, Coding scheme=Arithmetic coding, Chunk size=512 bytes2025.05 | 1,270 |