Factual Consistency Evaluation on ECTSum
80.93Precision (S, NU)LED-base-16384
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| LED-base-16384training=fine-tuned2025.12 | 80.93 | 77.49 | 53.72 | 49.12 | 42.54 | 50.55 | 50.03 | 42.71 | |
| BART-largetraining=fine-tuned, segmentation=ranking-based (LexRank)2025.12 | 75.47 | 72.36 | 58.73 | 42.02 | 40.97 | 55.32 | 42.79 | 41.34 | |
| BART-basetraining=fine-tuned, segmentation=ranking-based (LexRank)2025.12 | 74.02 | 71.36 | 60.85 | 31.66 | 35.08 | 58.23 | 34.65 | 37.4 | |
| PEGASUS-largetraining=fine-tuned, segmentation=ranking-based (LexRank)2025.12 | 72.35 | 64.88 | 67.75 | 66.12 | 56.05 | 62.87 | 42.25 | 45.03 |