Summarization on AIPubSum (test)
38.99ROUGE-1ChatGPT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ChatGPTPrompt Condition=add demonstration2026.06 | 38.99 | 16.33 | 36.69 | |
| ChatGPTPrompt Condition=add prompt2026.06 | 34.07 | 12.49 | 31.8 | |
| SOTA2026.06 | 33.8 | 12.7 | 30.8 | |
| BARTPrompt Condition=no prompt2026.06 | 29.66 | 8.39 | 24.29 | |
| Flan-T5Prompt Condition=add prompt2026.06 | 29.41 | 9.58 | 25.16 | |
| BARTPrompt Condition=add prompt2026.06 | 29.36 | 8.22 | 23.99 | |
| T5Prompt Condition=add prompt2026.06 | 26.93 | 7.03 | 22.49 | |
| T5Prompt Condition=no prompt2026.06 | 25.37 | 6.25 | 20.61 | |
| ChatGPTPrompt Condition=no prompt2026.06 | 24.62 | 8.75 | 22.27 | |
| GPT2Prompt Condition=no prompt2026.06 | 22.66 | 8.72 | 18.65 | |
| GPT2Prompt Condition=add prompt2026.06 | 22.55 | 8.47 | 18.55 | |
| Flan-T5Prompt Condition=no prompt2026.06 | 19.69 | 5.76 | 17.45 |