Summarization on CNN DailyMail (PRR)
0.45PRRTAD
Evaluation Results
| Method | Links | |
|---|---|---|
| TADBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08 | 0.45 | |
| LookBackLensBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08 | 0.369 | |
| CCPBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08 | 0.365 | |
| MSPBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08 | 0.339 | |
| MINDBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08 | 0.263 | |
| SheepsBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08 | 0.258 | |
| SATRMDBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08 | 0.254 | |
| Semantic DensityBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08 | 0.213 | |
| Simple FocusBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08 | 0.191 | |
| PerplexityBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08 | 0.172 | |
| Mean Token EntropyBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08 | 0.149 | |
| LUQBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08 | 0.131 | |
| Lexical Similarity Rouge-LBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08 | 0.122 | |
| FocusBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08 | 0.11 | |
| SARBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08 | 0.107 | |
| Semantic EntropyBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08 | 0.106 | |
| DegMat NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08 | 0.075 | |
| EigenScoreBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08 | 0.073 | |
| EVL NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08 | 0.068 | |
| SAPLMABackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08 | 0.009 | |
| FactoscopeBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08 | 0.001 | |
| Ecc. NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08 | -0.015 |