Text Compression on Wikipedia Salesforce/wikitext (test) benchmark leaderboard · SOTA2 Research

Text Compression on Wikipedia Salesforce/wikitext (test)

0.9862BERTScore F1 (r_keep=0.9)Llama SFT

Evaluation Results

Method	Links
Llama SFT2026.05		0.9862	0.9797	0.9514	0.9093	0.8275
Llama base2026.05		0.978	0.9565	0.8505	0.8668	0.8371
Entropy2026.05		0.973	0.9584	0.9194	0.8608	0.8103
WordLen2026.05		0.9724	0.9705	0.9334	0.8385	0.801
Step2026.05		0.9715	0.9473	0.8305	0.8131	0.8032
Entropy-LP2026.05		0.9714	0.9585	0.9207	0.8624	0.8122
Hybrid2026.05		0.971	0.9588	0.9126	0.8572	0.803
Hybrid2026.05		0.9704	0.96	0.9188	0.8613	0.8103
WF-Opt2026.05		0.9695	0.9577	0.9273	0.8816	0.8342
Hybrid2026.05		0.9688	0.9576	0.9079	0.8464	0.7912
WF-6class2026.05		0.9666	0.943	0.9069	0.8644	0.8282
Entropy-in-FreqBuckets2026.05		0.9665	0.9383	0.8798	0.8355	0.7982
WF-3class2026.05		0.9639	0.9432	0.9162	0.8812	0.8398