Summarization Evaluation on SummEval (Error Metrics)
0.495MSEMILE-RefHumEval
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MILE-RefHumEvalDimension=Relevance2026.02 | 0.495 | 0.704 | 0.557 | |
| MILE-RefHumEvalDimension=Consistency2026.02 | 0.596 | 0.772 | 0.567 | |
| MILE-RefHumEvalDimension=Fluency2026.02 | 0.641 | 0.801 | 0.685 | |
| MILE-RefHumEvalDimension=Coherence2026.02 | 0.927 | 0.963 | 0.761 | |
| G-Eval-4Dimension=Relevance2026.02 | 0.978 | 0.989 | 0.811 | |
| G-Eval-4Dimension=Coherence2026.02 | 1.258 | 1.122 | 0.91 | |
| G-Eval-4Dimension=Consistency2026.02 | 1.849 | 1.36 | 1.083 | |
| G-Eval-4Dimension=Fluency2026.02 | 4.473 | 2.115 | 2.037 |