Summarization Evaluation on SummEval Relevance Domain
0.96Corr.Human
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| HumanProtocol=Proposed Bayesian Protocol (Algorithm 2)2023.06 | 0.96 | 0 | 0 | 0.04 | 0.07 | 0.43 | |
| BLANCProtocol=Proposed Bayesian Protocol (Algorithm 2)2023.06 | 0.93 | 0 | 0.02 | 0.06 | 0.05 | 0.41 | |
| CIDErProtocol=Proposed Bayesian Protocol (Algorithm 2)2023.06 | 0.93 | 0 | 0.01 | 0.06 | 0.06 | 0.42 | |
| S3Protocol=Proposed Bayesian Protocol (Algorithm 2)2023.06 | 0.93 | 0 | 0.01 | 0.07 | 0.06 | 0.41 | |
| ROUGE-LProtocol=Proposed Bayesian Protocol (Algorithm 2)2023.06 | 0.92 | 0 | 0.01 | 0.08 | 0.05 | 0.41 | |
| SummaQAProtocol=Proposed Bayesian Protocol (Algorithm 2)2023.06 | 0.92 | 0 | 0.01 | 0.08 | 0.05 | 0.41 | |
| SUPERTProtocol=Proposed Bayesian Protocol (Algorithm 2)2023.06 | 0.91 | 0 | 0.01 | 0.08 | 0.06 | 0.39 | |
| BertScoreProtocol=Proposed Bayesian Protocol (Algorithm 2)2023.06 | 0.9 | 0 | 0.01 | 0.09 | 0.06 | 0.4 |