# Radiology Report Generation on Abdomen (test) Source: [Radiology Report Generation on Abdomen (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:37:18.387Z Evaluation of models generating radiology reports using the test split of the Abdomen dataset, assessed using metrics including BLEU-4, CIDEr, F1, and Recall. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Radiology Report Generation | | Dataset (including any stated split) | Abdomen (test) | | Metric | BLEU-4 | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [BLEU-4](): Higher is better; unit: SCALAR. - [CIDEr](): Higher is better; unit: SCALAR. - [F1 Score](): Higher is better; unit: SCALAR. - [Recall](): Higher is better; unit: SCALAR. - [BLEU-1](): Higher is better; unit: SCALAR. - [BLEU-2](): Higher is better; unit: SCALAR. - [BLEU-3](): Higher is better; unit: SCALAR. - [METEOR](): Higher is better; unit: SCALAR. - [ROUGE-L](): Higher is better; unit: SCALAR. ## Recorded results | Method | BLEU-4 | Result date | Report paper | | --- | --- | --- | --- | | X-RGen | 0.118 | Not recorded | 68fa75261e209131cea6627a | | X-RGen | 0.118 | Not recorded | 68fa75261e209131cea6627a | | X-RGen | 0.11 | Not recorded | 68fa75261e209131cea6627a | | Transformer | 0.108 | Not recorded | 68fa75261e209131cea6627a | | Transformer | 0.108 | Not recorded | 68fa75261e209131cea6627a | | X-RGen | 0.108 | Not recorded | 68fa75261e209131cea6627a | | X-RGen | 0.106 | Not recorded | 68fa75261e209131cea6627a | | X-RGen | 0.106 | Not recorded | 68fa75261e209131cea6627a | | R2Gen | 0.105 | Not recorded | 68fa75261e209131cea6627a | | MSAT | 0.105 | Not recorded | 68fa75261e209131cea6627a | | R2Gen | 0.105 | Not recorded | 68fa75261e209131cea6627a | | MSAT | 0.105 | Not recorded | 68fa75261e209131cea6627a | | R2Gen | 0.104 | Not recorded | 68fa75261e209131cea6627a | | R2GenCMN | 0.102 | Not recorded | 68fa75261e209131cea6627a | | R2GenCMN | 0.102 | Not recorded | 68fa75261e209131cea6627a | | R2Gen | 0.1 | Not recorded | 68fa75261e209131cea6627a | | R2Gen | 0.1 | Not recorded | 68fa75261e209131cea6627a | | R2Gen | 0.097 | Not recorded | 68fa75261e209131cea6627a | ### X-RGen BLEU-4: 0.118. Result ID: 6993908a3a6c31484916e556. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model category":"generalist","Batch size (bs)":"192"}. This record does not assert independent reproduction. ### X-RGen BLEU-4: 0.118. Result ID: 6993908a3a6c31484916e57c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"model\_category":"generalist","training\_batch\_size":192}. This record does not assert independent reproduction. ### X-RGen BLEU-4: 0.11. Result ID: 6993908a3a6c31484916e57b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"model\_category":"generalist","training\_batch\_size":96}. This record does not assert independent reproduction. ### Transformer BLEU-4: 0.108. Result ID: 6993908a3a6c31484916e550. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model category":"specialized","Batch size (bs)":"16"}. This record does not assert independent reproduction. ### Transformer BLEU-4: 0.108. Result ID: 6993908a3a6c31484916e572. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"model\_category":"specialised"}. This record does not assert independent reproduction. ### X-RGen BLEU-4: 0.108. Result ID: 6993908a3a6c31484916e57a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"model\_category":"generalist","training\_batch\_size":16}. This record does not assert independent reproduction. ### X-RGen BLEU-4: 0.106. Result ID: 6993908a3a6c31484916e554. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model category":"specialized","Batch size (bs)":"16"}. This record does not assert independent reproduction. ### X-RGen BLEU-4: 0.106. Result ID: 6993908a3a6c31484916e576. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"model\_category":"specialised"}. This record does not assert independent reproduction. ### R2Gen BLEU-4: 0.105. Result ID: 6993908a3a6c31484916e551. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model category":"specialized","Batch size (bs)":"16"}. This record does not assert independent reproduction. ### MSAT BLEU-4: 0.105. Result ID: 6993908a3a6c31484916e553. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model category":"specialized","Batch size (bs)":"16"}. This record does not assert independent reproduction. ### R2Gen BLEU-4: 0.105. Result ID: 6993908a3a6c31484916e573. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"model\_category":"specialised"}. This record does not assert independent reproduction. ### MSAT BLEU-4: 0.105. Result ID: 6993908a3a6c31484916e575. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"model\_category":"specialised"}. This record does not assert independent reproduction. ### R2Gen BLEU-4: 0.104. Result ID: 6993908a3a6c31484916e577. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"model\_category":"generalist","optimized\_on\_merged\_training\_dataset":true,"training\_batch\_size":16}. This record does not assert independent reproduction. ### R2GenCMN BLEU-4: 0.102. Result ID: 6993908a3a6c31484916e552. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model category":"specialized","Batch size (bs)":"16"}. This record does not assert independent reproduction. ### R2GenCMN BLEU-4: 0.102. Result ID: 6993908a3a6c31484916e574. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"model\_category":"specialised"}. This record does not assert independent reproduction. ### R2Gen BLEU-4: 0.1. Result ID: 6993908a3a6c31484916e555. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model category":"generalist","Batch size (bs)":"192"}. This record does not assert independent reproduction. ### R2Gen BLEU-4: 0.1. Result ID: 6993908a3a6c31484916e579. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"model\_category":"generalist","optimized\_on\_merged\_training\_dataset":true,"training\_batch\_size":192}. This record does not assert independent reproduction. ### R2Gen BLEU-4: 0.097. Result ID: 6993908a3a6c31484916e578. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"model\_category":"generalist","optimized\_on\_merged\_training\_dataset":true,"training\_batch\_size":96}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.