Summarization on CrossSum 1.0 (test)
43.8ROUGE-1Pisces
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| PiscesParameters=610M, Source Language=Fr, Target Language=Zh, Zero-shot=true2023.05 | 43.8 | 25.7 | 38.7 | 73 | |
| PiscesParameters=610M, Source Language=Zh, Target Language=Fr, Zero-shot=true2023.05 | 39.1 | 22.5 | 32.5 | 70.7 | |
| PiscesParameters=610M, Source Language=Tr, Target Language=Fr, Zero-shot=true2023.05 | 38.3 | 18.9 | 30.8 | 70.2 | |
| PiscesParameters=610M, Source Language=Th, Target Language=Fr, Zero-shot=true2023.05 | 38 | 19.6 | 30.4 | 69.4 | |
| PiscesParameters=610M, Source Language=Hi, Target Language=Fr, Zero-shot=true2023.05 | 35.3 | 15.9 | 28 | 68.7 | |
| PiscesParameters=610M, Source Language=Avg, Target Language=Avg2023.05 | 34.2 | 14.5 | 27.8 | 68.3 | |
| PiscesParameters=610M, Source Language=En, Target Language=Fr, Zero-shot=false2023.05 | 33.6 | 13.4 | 25.6 | 67.6 | |
| PiscesParameters=610M, Source Language=Hi, Target Language=Avg2023.05 | 32.6 | 12.8 | 26.4 | 67.9 | |
| PiscesParameters=610M, Source Language=En, Target Language=En, Zero-shot=false2023.05 | 32 | 9.1 | 23.7 | 67.4 | |
| mBARTParameters=610M, Source Language=Fr, Target Language=En, Zero-shot=false2023.05 | 31.9 | 10.3 | 23.8 | 67.4 | |
| PiscesParameters=610M, Source Language=En, Target Language=Avg, Zero-shot=false2023.05 | 31.3 | 10.7 | 24.7 | 67.2 | |
| mBARTParameters=610M, Source Language=En, Target Language=En, Zero-shot=false2023.05 | 31.2 | 8.7 | 22.8 | 66.9 | |
| mT5Parameters=580M, Source Language=Fr, Target Language=En, Zero-shot=false2023.05 | 30.7 | 10.1 | 23.4 | 66.6 | |
| mT5Parameters=580M, Source Language=En, Target Language=En, Zero-shot=false2023.05 | 30.1 | 8.3 | 22.3 | 66.3 | |
| PiscesParameters=610M, Source Language=Fr, Target Language=En, Zero-shot=false2023.05 | 11.7 | — | 25.8 | 68.2 |