Summarization on NYT Summarization (test)
5.24Hallucination RateCAE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CAE# Rem=50K2022.12 | 5.24 | 42.51 | |
| Oracle# Rem=23K2022.12 | 7.14 | 44.94 | |
| CAE# Rem=20K2022.12 | 11.9 | 43.82 | |
| BartScore# Rem=50K2022.12 | 14.27 | 43.11 | |
| BM25# Rem=50K2022.12 | 14.81 | 43.67 | |
| BartScore# Rem=20K2022.12 | 15 | 44.28 | |
| BM25# Rem=20K2022.12 | 16.04 | 44.22 | |
| TracIn# Rem=20K2022.12 | 17.16 | 43.16 | |
| TracIn# Rem=50K2022.12 | 17.86 | 41.16 | |
| Baseline# Rem=02022.12 | 18.05 | 44.54 |