Text Summarization on BillSum (test)
97.3CoherenceGPT-4
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| GPT-42024.06 | 97.3 | 84.3 | 83.1 | 97.1 | 90.4 | 44.3 | 85.1 | |
| BART_largeFine-tune=SFT+MDO_pro2024.06 | 90 | 89.5 | 87.7 | 87.1 | 88.6 | 43.2 | 92.2 | |
| BART_largeFine-tune=SFT+MDO_min2024.06 | 89.9 | 89.4 | 88.2 | 86.9 | 88.6 | 43.5 | 92.4 | |
| BART_largeFine-tune=SFT2024.06 | 88.4 | 86.5 | 86.4 | 84.3 | 86.4 | 42.4 | 90.4 | |
| T5_baseFine-tune=SFT+MDO_pro2024.06 | 88.2 | 88.7 | 85.8 | 83.6 | 86.6 | 43.5 | 92.2 | |
| T5_baseFine-tune=SFT+MDO_min2024.06 | 87.2 | 88.3 | 85 | 81.9 | 85.6 | 43.3 | 91.8 | |
| BART_baseFine-tune=SFT+MDO_min2024.06 | 85.9 | 85.7 | 85.3 | 80.6 | 84.3 | 43.1 | 92.4 | |
| BART_baseFine-tune=SFT+MDO_pro2024.06 | 85.7 | 85.3 | 84.6 | 81.3 | 84.2 | 42.8 | 92.4 | |
| T5_baseFine-tune=SFT2024.06 | 84 | 87.4 | 83.2 | 77.5 | 83 | 43 | 91.2 | |
| BART_baseFine-tune=SFT2024.06 | 83.8 | 83.3 | 84.5 | 77.9 | 82.4 | 42.5 | 90.2 | |
| PEGASUSFine-tune=SFT2024.06 | 82.3 | 83.2 | 84.9 | 81.4 | 83 | 39.2 | 89.9 |