Summarization Evaluation on SummEval (Pearson, Spearman, and Kendall Correlation)
0.546Pearson CorrelationLLaDA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LLaDATrain=FS+RO, Prompt=Judge Infill2026.04 | 0.546 | 0.535 | 0.423 | |
| LLaDATrain=RO, Prompt=Judge Infill2026.04 | 0.516 | 0.504 | 0.396 | |
| LLaDATrain=FS+RO, Prompt=Judge2026.04 | 0.5 | 0.507 | 0.404 | |
| LLaDATrain=RO, Prompt=Judge2026.04 | 0.484 | 0.495 | 0.391 | |
| LLaDATrain=None, Prompt=C-gen2026.04 | 0.465 | 0.439 | 0.339 | |
| DreamTrain=FS+RO, Prompt=C-gen Infill2026.04 | 0.461 | 0.454 | 0.344 | |
| LLaDATrain=RO, Prompt=C-gen2026.04 | 0.454 | 0.491 | 0.399 | |
| LLaDATrain=FS, Prompt=G-Eval2026.04 | 0.453 | 0.436 | 0.346 | |
| LLaDATrain=FS, Prompt=Judge2026.04 | 0.447 | 0.481 | 0.385 | |
| LLaDATrain=FS+RO, Prompt=C-gen2026.04 | 0.432 | 0.449 | 0.359 | |
| LLaDATrain=RO, Prompt=G-Eval2026.04 | 0.418 | 0.482 | 0.373 | |
| LLaDATrain=None, Prompt=G-eval2026.04 | 0.397 | 0.289 | 0.217 | |
| LLaDATrain=FS+RO, Prompt=G-Eval2026.04 | 0.386 | 0.48 | 0.38 | |
| LLaDATrain=FS, Prompt=C-gen2026.04 | 0.376 | 0.404 | 0.322 | |
| DreamTrain=FS+RO, Prompt=Judge Infill2026.04 | 0.368 | 0.381 | 0.3 | |
| DreamTrain=FS, Prompt=C-gen Infill2026.04 | 0.344 | 0.328 | 0.258 | |
| DreamTrain=FS+RO, Prompt=C-gen2026.04 | 0.326 | 0.346 | 0.266 | |
| DreamTrain=RO, Prompt=G-Eval2026.04 | 0.323 | 0.323 | 0.248 | |
| LLaDATrain=FS, Prompt=Judge Infill2026.04 | 0.32 | 0.465 | 0.369 | |
| LLaDATrain=FS, Prompt=C-gen Infill2026.04 | 0.317 | 0.345 | 0.275 | |
| DreamTrain=FS, Prompt=C-gen2026.04 | 0.317 | 0.361 | 0.277 | |
| DreamTrain=FS+RO, Prompt=G-Eval2026.04 | 0.312 | 0.314 | 0.244 | |
| LLaDATrain=None, Prompt=Judge2026.04 | 0.308 | 0.336 | 0.261 | |
| DreamTrain=None, Prompt=C-gen2026.04 | 0.292 | 0.279 | 0.225 | |
| DreamTrain=RO, Prompt=Judge2026.04 | 0.285 | 0.322 | 0.255 | |
| DreamTrain=RO, Prompt=C-gen2026.04 | 0.264 | 0.261 | 0.201 | |
| DreamTrain=RO, Prompt=Judge Infill2026.04 | 0.26 | 0.267 | 0.205 | |
| DreamTrain=None, Prompt=G-eval2026.04 | 0.247 | 0.231 | 0.184 | |
| DreamTrain=RO, Prompt=C-gen Infill2026.04 | 0.247 | 0.2 | 0.151 | |
| DreamTrain=FS, Prompt=Judge2026.04 | 0.244 | 0.23 | 0.18 | |
| DreamTrain=FS+RO, Prompt=Judge2026.04 | 0.227 | 0.222 | 0.173 | |
| DreamTrain=FS, Prompt=Judge Infill2026.04 | 0.22 | 0.216 | 0.167 | |
| LLaDATrain=FS+RO, Prompt=C-gen Infill2026.04 | 0.209 | 0.159 | 0.128 | |
| DreamTrain=FS, Prompt=G-Eval2026.04 | 0.206 | 0.338 | 0.264 | |
| DreamTrain=None, Prompt=Judge2026.04 | 0.192 | 0.181 | 0.136 | |
| DreamTrain=None, Prompt=Judge Infill2026.04 | 0.153 | 0.16 | 0.122 | |
| DreamTrain=None, Prompt=C-gen Infill2026.04 | 0.149 | 0.143 | 0.112 | |
| LLaDATrain=None, Prompt=Judge Infill2026.04 | 0.05 | 0.087 | 0.064 | |
| LLaDATrain=RO, Prompt=C-gen Infill2026.04 | 0.038 | 0.058 | 0.042 | |
| LLaDATrain=None, Prompt=C-gen Infill2026.04 | -0.005 | -0.013 | -0.009 |