Abstractive Summarization on OrangeSum (test)
100ROUGE-LGround Truth
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Ground TruthEncoding type=Manual2026.03 | 100 | 100 | 78.36 | 72.84 | 2.41 | 32.13 | |
| flanT5-baseEncoding type=Token-Encoding2026.03 | 22.61 | 27.54 | 94 | 92.37 | 8.6 | 27.87 | |
| BARThezEncoding type=Token-Encoding2026.03 | 22.57 | 27.95 | 91.65 | 89.11 | 6.66 | 24.71 | |
| mBART-50Encoding type=Token-Encoding2026.03 | 22.05 | 26.76 | 93.13 | 90.96 | 8.63 | 27.72 | |
| mT5-smallEncoding type=Token-Encoding2026.03 | 20.22 | 24.06 | 95.22 | 95.39 | 9.99 | 25.88 | |
| SBARThez-BGEEncoding type=Sentence-Encoding, NE injection=true2026.03 | 20.22 | 26.05 | 78.54 | 72.3 | 1.67 | 20.67 | |
| SBARThez-SONAREncoding type=Sentence-Encoding, NE injection=true2026.03 | 19.4 | 25.37 | 78.52 | 72.7 | 1.6 | 20.93 | |
| SBARThez-LaBSEEncoding type=Sentence-Encoding, NE injection=true2026.03 | 18.56 | 24.24 | 74.64 | 68.71 | 1.45 | 21.9 |