Extractive Summarization on WikiLingua (test)
30.81Score (De)Oracle
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Oracleselection_method=greedy algorithm2022.04 | 30.81 | 36.52 | 34.64 | 33.99 | |
| NLSSummode=Zero-Shot, backbone=XLMR-Large2022.04 | 22.45 | 26.98 | 25.34 | 24.92 | |
| XLMRSum-WRmode=Zero-Shot, backbone=XLMR-Large, augmentation=bilingual dictionary word replacement2022.04 | 22.2 | 26.78 | 25.1 | 24.69 | |
| XLMRSummode=Zero-Shot, backbone=XLMR-Large2022.04 | 22.1 | 26.73 | 25.06 | 24.63 | |
| XLMRSum-MTmode=Zero-Shot, backbone=XLMR-Large, augmentation=machine translation2022.04 | 21.92 | 26.41 | 24.75 | 24.36 | |
| mBERTSummode=Zero-Shot, backbone=mBERT2022.04 | 18.83 | 22.49 | 20.91 | 20.74 | |
| Lead-3k=3, mode=baseline2022.04 | 16.32 | 19.78 | 18.4 | 18.17 |