Text Reconstruction on Zhihu answers
99.07BERTScore F1Qwen SFT
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen SFTrkeep=0.92026.05 | 99.07 | |
| Entropy-in-FreqBucketsrkeep=0.92026.05 | 97.8 | |
| Word Frequencyrkeep=0.92026.05 | 97.02 | |
| Word Lengthrkeep=0.92026.05 | 96.92 | |
| Entropy-LPrkeep=0.92026.05 | 96.36 | |
| Entropyrkeep=0.92026.05 | 96.34 | |
| Hybrid-0.3rkeep=0.92026.05 | 96.3 | |
| Hybrid-0.7rkeep=0.92026.05 | 96.29 | |
| Hybrid-0.5rkeep=0.92026.05 | 96.24 | |
| Steprkeep=0.92026.05 | 96.22 | |
| Opt (w/ polish)rkeep=0.92026.05 | 95.61 | |
| Opt (w/o polish)rkeep=0.92026.05 | 95.54 | |
| Qwen baserkeep=0.92026.05 | 95.06 | |
| Qwen SFTrkeep=0.72026.05 | 93.78 | |
| Word Lengthrkeep=0.72026.05 | 90.89 | |
| Word Frequencyrkeep=0.72026.05 | 90.66 | |
| Entropyrkeep=0.72026.05 | 90.55 | |
| Entropy-LPrkeep=0.72026.05 | 90.46 | |
| Steprkeep=0.72026.05 | 90.23 | |
| Qwen SFTrkeep=0.52026.05 | 89.8 | |
| Opt (w/ polish)rkeep=0.72026.05 | 89.38 | |
| Hybrid-0.3rkeep=0.72026.05 | 89.12 | |
| Opt (w/o polish)rkeep=0.72026.05 | 89 | |
| Hybrid-0.7rkeep=0.72026.05 | 88.61 | |
| Entropy-in-FreqBucketsrkeep=0.72026.05 | 88.34 | |
| Hybrid-0.5rkeep=0.72026.05 | 87.99 | |
| Qwen SFTrkeep=0.32026.05 | 83.77 | |
| Word Lengthrkeep=0.52026.05 | 80.69 | |
| Entropyrkeep=0.52026.05 | 80.47 | |
| Hybrid-0.3rkeep=0.52026.05 | 80.37 | |
| Entropy-LPrkeep=0.52026.05 | 80.27 | |
| Word Frequencyrkeep=0.52026.05 | 80 | |
| Qwen baserkeep=0.72026.05 | 80 | |
| Hybrid-0.5rkeep=0.52026.05 | 79.47 | |
| Opt (w/o polish)rkeep=0.52026.05 | 79.01 | |
| Steprkeep=0.52026.05 | 78.89 | |
| Opt (w/ polish)rkeep=0.52026.05 | 78.78 | |
| Hybrid-0.7rkeep=0.52026.05 | 78.74 | |
| Entropy-in-FreqBucketsrkeep=0.52026.05 | 77.32 | |
| Entropy-LPrkeep=0.32026.05 | 73.41 | |
| Hybrid-0.5rkeep=0.32026.05 | 73.25 | |
| Hybrid-0.3rkeep=0.32026.05 | 73.1 | |
| Entropyrkeep=0.32026.05 | 72.32 | |
| Hybrid-0.7rkeep=0.32026.05 | 71.24 | |
| Opt (w/ polish)rkeep=0.32026.05 | 70.33 | |
| Entropy-in-FreqBucketsrkeep=0.32026.05 | 69.93 | |
| Opt (w/o polish)rkeep=0.32026.05 | 69.86 | |
| Word Lengthrkeep=0.32026.05 | 69.32 | |
| Word Frequencyrkeep=0.32026.05 | 69.1 | |
| Steprkeep=0.32026.05 | 68.73 | |
| Qwen baserkeep=0.32026.05 | 64.82 | |
| Qwen baserkeep=0.52026.05 | 64.69 | |
| Entropy-LPrkeep=0.12026.05 | 64.31 | |
| Hybrid-0.5rkeep=0.12026.05 | 64.27 | |
| Hybrid-0.3rkeep=0.12026.05 | 63.74 | |
| Hybrid-0.7rkeep=0.12026.05 | 63.31 | |
| Opt (w/ polish)rkeep=0.12026.05 | 63.01 | |
| Entropyrkeep=0.12026.05 | 62.48 | |
| Steprkeep=0.12026.05 | 62.31 | |
| Word Lengthrkeep=0.12026.05 | 62.21 | |
| Word Frequencyrkeep=0.12026.05 | 61.82 | |
| Entropy-in-FreqBucketsrkeep=0.12026.05 | 60.6 | |
| Qwen SFTrkeep=0.12026.05 | 59.88 | |
| Opt (w/o polish)rkeep=0.12026.05 | 58.46 | |
| Qwen baserkeep=0.12026.05 | 57.31 |