Medical Report Generation on IU X-Ray (test)
21.5BLEU-4SGF
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| SGFYear=20222025.05 | 21.5 | — | — | — | 20.1 | 41.5 | — | — | |
| SSMYear=20252025.05 | 20.1 | — | — | — | 21.1 | 41.1 | — | — | |
| UARYear=20232025.05 | 20 | — | — | — | 21.8 | 40.5 | — | — | |
| MWCLYear=20252025.05 | 19.6 | — | — | — | 21.3 | 40.9 | — | — | |
| VLCIYear=20252025.05 | 18.9 | — | — | — | 20.4 | 39.7 | — | — | |
| ITAYear=20222025.05 | 18.8 | — | — | — | 20.8 | 38.2 | — | — | |
| MCSAMYear=20242025.05 | 18.4 | — | — | — | 21 | 39.4 | — | — | |
| MiniGPT-4-RRGYear=20242025.05 | 18.4 | — | — | — | 20.8 | 39 | — | — | |
| CMM+RLYear=20222025.05 | 18.1 | — | — | — | 20.1 | 38.4 | — | — | |
| PGTYear=20222025.05 | 18.1 | — | — | — | 20.3 | 38.1 | — | — | |
| LLaMA-XRYear=-2025.05 | 18 | — | — | — | 33.6 | 43.3 | — | — | |
| CvT-DistilGPT2Year=20232025.05 | 17.7 | — | — | — | 19.3 | 37.7 | — | — | |
| CATYear=20252025.05 | 17.6 | — | — | — | 19.5 | 38.3 | — | — | |
| R2gen-mambaYear=20252025.05 | 17.6 | — | — | — | 20.8 | 38.2 | — | — | |
| JPGYear=20222025.05 | 17.4 | — | — | — | 19.3 | 37.7 | — | — | |
| MDAKFYear=20242025.05 | 17.4 | — | — | — | 19.4 | 38.9 | — | — | |
| R2GenGPTYear=20232025.05 | 17.3 | — | — | — | 21.1 | 37.7 | — | — | |
| ASGMDYear=20242025.05 | 17.3 | — | — | — | 20.6 | 39.7 | — | — | |
| METransformerYear=20232025.05 | 17.2 | — | — | — | 19.2 | 38 | — | — | |
| LACCOLYear=20252025.05 | 17.2 | — | — | — | 19.8 | 39.2 | — | — | |
| MANYear=20242025.05 | 17 | — | — | — | 21.3 | 38.6 | — | — | |
| MAMRGYear=20242025.05 | 17 | — | — | — | 21.3 | 38.6 | — | — | |
| PPKEDYear=20212025.05 | 16.8 | — | — | — | 19 | 37.6 | — | — | |
| R2GenCMNYear=20222025.05 | 16.8 | — | — | — | 19.8 | 37 | — | — | |
| Med-LLMYear=20242025.05 | 16.8 | — | — | — | 20.9 | 38.1 | — | — | |
| R2GenYear=20202025.05 | 16.5 | — | — | — | 18.7 | 37.1 | — | — | |
| DCLYear=20232025.05 | 16.3 | — | — | — | 19.3 | 38.3 | — | — | |
| CMCLYear=20222025.05 | 16.2 | — | — | — | 18.6 | 37.8 | — | — | |
| UPDP (Augmented: Full)Transfer Target Sim=true, Transfer Semantic=true, Local=true, Backbone=Qwen2.5-VL-7B-Instruct2026.04 | 15.83 | 47.01 | 31.58 | 22.27 | 22.45 | 34.5 | 41.28 | 42.57 | |
| CMAS-RLYear=20192025.05 | 15.4 | — | — | — | — | 36.2 | — | — | |
| Tm-HRNNYear=20192025.05 | 15.4 | — | — | — | 17.5 | 34.4 | — | — | |
| VTIYear=20212025.05 | 15.4 | — | — | — | 21.8 | 37.5 | — | — | |
| H-AgentYear=20182025.05 | 15.1 | — | — | — | — | 32.2 | — | — | |
| UPDP (Augmented: Target Sim only)Transfer Target Sim=true, Transfer Semantic=false, Local=true, Backbone=Qwen2.5-VL-7B-Instruct2026.04 | 15.03 | 46.95 | 31.29 | 21.27 | 22.15 | 35.25 | 40.67 | 41.91 | |
| SentSAT+KGYear=20202025.05 | 14.7 | — | — | — | — | 36.7 | — | — | |
| Qwen2.5-VL-7B-Instruct (Augmented: Non-de-identified)Transfer Target Sim=false, Transfer Semantic=false, Local=true, Backbone=Qwen2.5-VL-7B-Instruct2026.04 | 14.58 | 45.37 | 29.89 | 20.97 | 21.38 | 34.27 | 39.02 | 39.69 | |
| Qwen2.5-VL-7B-Instruct (Local Only)Transfer Target Sim=false, Transfer Semantic=false, Local=true, Backbone=Qwen2.5-VL-7B-Instruct2026.04 | 13.98 | 45.47 | 30.05 | 20.74 | 21.11 | 33.84 | 41.01 | 41.48 | |
| UPDP (Full)Transfer Target Sim=true, Transfer Semantic=true, Local=false, Backbone=Qwen2.5-VL-7B-Instruct2026.04 | 13.84 | 44.42 | 31.58 | 19.9 | 21.08 | 33.58 | 39.1 | 38.14 | |
| TransformerYear=20172025.05 | 13.7 | — | — | — | 17.2 | 33.5 | — | — | |
| UPDP (Partial: Target Sim only)Transfer Target Sim=true, Transfer Semantic=false, Local=false, Backbone=Qwen2.5-VL-7B-Instruct2026.04 | 13.48 | 43.57 | 28.41 | 19.45 | 20.9 | 32.89 | 38.04 | 37.65 | |
| Qwen2.5-VL-7B-Instruct (Non-de-identified Transfer)Transfer Target Sim=false, Transfer Semantic=false, Local=false, Backbone=Qwen2.5-VL-7B-Instruct2026.04 | 12.39 | 42.78 | 28.3 | 17.7 | 19.96 | 32.33 | 37.58 | 37.01 |