# Medical Report Generation on Six Medical Datasets Average Merged (test) Source: [Medical Report Generation on Six Medical Datasets Average Merged (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:37:13.572Z Evaluation of models generating medical reports by averaging results across the test splits of six distinct medical datasets, typically assessed using standard NLP metrics like BLEU, METEOR, ROUGE, and CIDEr. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Medical Report Generation | | Dataset (including any stated split) | Six Medical Datasets Average Merged (test) | | Metric | BLEU-1 | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 11 of 11 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [BLEU-1](): Higher is better; unit: SCALAR. - [BLEU-2](): Higher is better; unit: SCALAR. - [BLEU-3](): Higher is better; unit: SCALAR. - [BLEU-4](): Higher is better; unit: SCALAR. - [METEOR](): Higher is better; unit: SCALAR. - [ROUGE-L](): Higher is better; unit: SCALAR. - [CIDEr](): Higher is better; unit: SCALAR. ## Recorded results | Method | BLEU-1 | Result date | Report paper | | --- | --- | --- | --- | | X-RGen | 0.401 | Not recorded | 68fa75261e209131cea6627a | | MSAT | 0.393 | Not recorded | 68fa75261e209131cea6627a | | X-RGen | 0.383 | Not recorded | 68fa75261e209131cea6627a | | R2Gen | 0.382 | Not recorded | 68fa75261e209131cea6627a | | R2Gen | 0.374 | Not recorded | 68fa75261e209131cea6627a | | R2GenCMN | 0.371 | Not recorded | 68fa75261e209131cea6627a | | X-RGen | 0.37 | Not recorded | 68fa75261e209131cea6627a | | R2Gen | 0.369 | Not recorded | 68fa75261e209131cea6627a | | Transformer | 0.368 | Not recorded | 68fa75261e209131cea6627a | | X-RGen | 0.363 | Not recorded | 68fa75261e209131cea6627a | | R2Gen | 0.345 | Not recorded | 68fa75261e209131cea6627a | ### X-RGen BLEU-1: 0.401. Result ID: 6993908a3a6c31484916e597. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Category":"generalist models","batch size":"192"}. This record does not assert independent reproduction. ### MSAT BLEU-1: 0.393. Result ID: 6993908a3a6c31484916e590. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"specialised models"}. This record does not assert independent reproduction. ### X-RGen BLEU-1: 0.383. Result ID: 6993908a3a6c31484916e596. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Category":"generalist models","batch size":"96"}. This record does not assert independent reproduction. ### R2Gen BLEU-1: 0.382. Result ID: 6993908a3a6c31484916e593. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"generalist models","batch size":"96"}. This record does not assert independent reproduction. ### R2Gen BLEU-1: 0.374. Result ID: 6993908a3a6c31484916e58e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"specialised models"}. This record does not assert independent reproduction. ### R2GenCMN BLEU-1: 0.371. Result ID: 6993908a3a6c31484916e58f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"specialised models"}. This record does not assert independent reproduction. ### X-RGen BLEU-1: 0.37. Result ID: 6993908a3a6c31484916e591. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Category":"specialised models"}. This record does not assert independent reproduction. ### R2Gen BLEU-1: 0.369. Result ID: 6993908a3a6c31484916e594. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"generalist models","batch size":"192","optimized on merged training dataset":true}. This record does not assert independent reproduction. ### Transformer BLEU-1: 0.368. Result ID: 6993908a3a6c31484916e58d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Category":"specialised models"}. This record does not assert independent reproduction. ### X-RGen BLEU-1: 0.363. Result ID: 6993908a3a6c31484916e595. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Category":"generalist models","batch size":"16"}. This record does not assert independent reproduction. ### R2Gen BLEU-1: 0.345. Result ID: 6993908a3a6c31484916e592. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"generalist models","batch size":"16"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.