Summarization on OPEN-I and MIMIC-CXR combined (test)
56.5ROUGE-LCSTRL
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| CSTRL2025.02 | 56.5 | 58.1 | 48.5 | 65 | 47.9 | 38.9 | |
| Content Selector2025.02 | 51.8 | 53.6 | 40.8 | — | — | — | |
| BASE+GRAPH+CL2025.02 | 47.1 | 49.1 | 33.7 | — | — | — | |
| WGSUM (Trans+GAT)2025.02 | 46.7 | 48.3 | 33.3 | — | — | — | |
| BASE+AP+DCA2025.02 | 46.1 | 47.6 | 32 | — | — | — | |
| ChestXRayBERT2025.02 | 41.5 | 41.3 | 28.6 | 28.5 | 14.4 | 6.1 | |
| BART2025.02 | 39.7 | 39.4 | 27.3 | 28.3 | 14.2 | 5.8 | |
| RadSum2025.02 | 39.2 | 37.9 | 25.5 | 28 | 13.9 | 5.5 | |
| TransAbs2025.02 | 38.7 | 37.7 | 26.9 | 28.1 | 14.1 | 5.7 | |
| PGN(Cov)2025.02 | 37.5 | 36.6 | 24.2 | 27.6 | 13.7 | 5.4 | |
| PGN2025.02 | 35.7 | 36.1 | 23.9 | 23.9 | 11.3 | 4.6 | |
| Seq2Seq2025.02 | 35.4 | 35.1 | 23.7 | 24.3 | 11.5 | 4.1 | |
| Meta-Llama-3-8B2025.02 | 29 | — | — | — | — | 9.4 | |
| Meta-Llama-3-1BEvaluation Protocol=Few-shot2025.02 | 27.9 | 30.5 | 12.9 | 31.2 | 55.2 | 67.4 | |
| Meta-Llama-3-1BEvaluation Protocol=Zero-shot2025.02 | 0.2 | 0.2 | 0.1 | 0.8 | 0.3 | 0.1 |