List your company
ResearchFormerly WizWand

Summarization on CNN DailyMail (PRR)

0.45PRRTAD
-0.03360.091950.21750.34305Aug 20, 2024
Updated 6mo ago

Evaluation results

MethodLinks
TADBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.45
LookBackLensBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.369
CCPBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.365
MSPBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.339
MINDBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.263
SheepsBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.258
SATRMDBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.254
Semantic DensityBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.213
Simple FocusBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.191
PerplexityBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.172
Mean Token EntropyBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.149
LUQBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.131
Lexical Similarity Rouge-LBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.122
FocusBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.11
SARBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.107
Semantic EntropyBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.106
DegMat NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.075
EigenScoreBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.073
EVL NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.068
SAPLMABackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.009
FactoscopeBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.001
Ecc. NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08-0.015