Summarization on XSUM & AESLC WMT-14 (test)
0.44Overall ScoreSNNE
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SNNEModel=Phi-3-mini, Correctness Metric=BERTScore2025.05 | 0.44 | — | — | — | — | — | — | — | — | — | — | — | — | 0.64 | |
| WSNNEModel=Phi-3-mini, Correctness Metric=BERTScore2025.05 | 0.44 | — | — | — | 0.65 | — | — | — | — | — | — | — | — | — | |
| KLEfullModel=Phi-3-mini, Correctness Metric=BERTScore2025.05 | 0.44 | 0.54 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SEModel=Phi-3-mini, Correctness Metric=BERTScore2025.05 | 0.44 | — | 0.36 | — | — | — | — | — | — | — | — | — | — | — | |
| NEModel=Phi-3-mini, Correctness Metric=BERTScore2025.05 | 0.44 | — | — | 0.43 | — | — | — | — | — | — | — | — | — | — | |
| KLEheatModel=Phi-3-mini, Correctness Metric=BERTScore2025.05 | 0.44 | — | — | — | — | 0.56 | — | — | — | — | — | — | — | — | |
| DSEModel=Phi-3-mini, Correctness Metric=BERTScore2025.05 | 0.44 | — | — | — | — | — | 0.37 | — | — | — | — | — | — | — | |
| pTrueModel=Phi-3-mini, Correctness Metric=BERTScore2025.05 | 0.44 | — | — | — | — | — | — | 0.52 | — | — | — | — | — | — | |
| NumSetModel=Phi-3-mini, Correctness Metric=BERTScore2025.05 | 0.44 | — | — | — | — | — | — | — | 0.38 | — | — | — | — | — | |
| LexSimModel=Phi-3-mini, Correctness Metric=BERTScore2025.05 | 0.44 | — | — | — | — | — | — | — | — | 0.58 | — | — | — | — | |
| SumEigvModel=Phi-3-mini, Correctness Metric=BERTScore2025.05 | 0.44 | — | — | — | — | — | — | — | — | — | 0.47 | — | — | — | |
| DegModel=Phi-3-mini, Correctness Metric=BERTScore2025.05 | 0.44 | — | — | — | — | — | — | — | — | — | — | 0.48 | — | — | |
| EccenModel=Phi-3-mini, Correctness Metric=BERTScore2025.05 | 0.44 | — | — | — | — | — | — | — | — | — | — | — | 0.52 | — | |
| SNNEModel=Phi-3-mini, Correctness Metric=ROUGE-L2025.05 | 0.11 | — | — | — | — | — | — | — | — | — | — | — | — | 0.26 | |
| WSNNEModel=Phi-3-mini, Correctness Metric=ROUGE-L2025.05 | 0.11 | — | — | — | 0.27 | — | — | — | — | — | — | — | — | — | |
| KLEfullModel=Phi-3-mini, Correctness Metric=ROUGE-L2025.05 | 0.11 | 0.2 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SEModel=Phi-3-mini, Correctness Metric=ROUGE-L2025.05 | 0.11 | — | 0.14 | — | — | — | — | — | — | — | — | — | — | — | |
| NEModel=Phi-3-mini, Correctness Metric=ROUGE-L2025.05 | 0.11 | — | — | 0.17 | — | — | — | — | — | — | — | — | — | — | |
| KLEheatModel=Phi-3-mini, Correctness Metric=ROUGE-L2025.05 | 0.11 | — | — | — | — | 0.21 | — | — | — | — | — | — | — | — | |
| DSEModel=Phi-3-mini, Correctness Metric=ROUGE-L2025.05 | 0.11 | — | — | — | — | — | 0.14 | — | — | — | — | — | — | — | |
| pTrueModel=Phi-3-mini, Correctness Metric=ROUGE-L2025.05 | 0.11 | — | — | — | — | — | — | 0.24 | — | — | — | — | — | — | |
| NumSetModel=Phi-3-mini, Correctness Metric=ROUGE-L2025.05 | 0.11 | — | — | — | — | — | — | — | 0.17 | — | — | — | — | — | |
| LexSimModel=Phi-3-mini, Correctness Metric=ROUGE-L2025.05 | 0.11 | — | — | — | — | — | — | — | — | 0.23 | — | — | — | — | |
| SumEigvModel=Phi-3-mini, Correctness Metric=ROUGE-L2025.05 | 0.11 | — | — | — | — | — | — | — | — | — | 0.19 | — | — | — | |
| DegModel=Phi-3-mini, Correctness Metric=ROUGE-L2025.05 | 0.11 | — | — | — | — | — | — | — | — | — | — | 0.19 | — | — | |
| EccenModel=Phi-3-mini, Correctness Metric=ROUGE-L2025.05 | 0.11 | — | — | — | — | — | — | — | — | — | — | — | 0.2 | — |