Radiology Report Generation on Abdomen (test)
0.118BLEU-4X-RGen
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| X-RGenModel category=generalist, Batch size (bs)=1922023.05 | 0.118 | 0.327 | 0.58 | 0.565 | — | — | — | — | — | |
| X-RGenmodel_category=generalist, training_batch_size=1922023.05 | 0.118 | 0.327 | — | — | 0.432 | 0.269 | 0.175 | 0.161 | 0.322 | |
| X-RGenmodel_category=generalist, training_batch_size=962023.05 | 0.11 | 0.292 | — | — | 0.409 | 0.252 | 0.162 | 0.159 | 0.313 | |
| TransformerModel category=specialized, Batch size (bs)=162023.05 | 0.108 | 0.261 | 0.559 | 0.546 | — | — | — | — | — | |
| Transformermodel_category=specialised2023.05 | 0.108 | 0.261 | — | — | 0.409 | 0.247 | 0.161 | 0.142 | 0.314 | |
| X-RGenmodel_category=generalist, training_batch_size=162023.05 | 0.108 | 0.276 | — | — | 0.395 | 0.243 | 0.159 | 0.152 | 0.305 | |
| X-RGenModel category=specialized, Batch size (bs)=162023.05 | 0.106 | 0.196 | 0.565 | 0.559 | — | — | — | — | — | |
| X-RGenmodel_category=specialised2023.05 | 0.106 | 0.196 | — | — | 0.373 | 0.228 | 0.154 | 0.137 | 0.314 | |
| R2GenModel category=specialized, Batch size (bs)=162023.05 | 0.105 | 0.248 | 0.558 | 0.554 | — | — | — | — | — | |
| MSATModel category=specialized, Batch size (bs)=162023.05 | 0.105 | 0.275 | — | — | — | — | — | — | — | |
| R2Genmodel_category=specialised2023.05 | 0.105 | 0.248 | — | — | 0.389 | 0.241 | 0.156 | 0.143 | 0.309 | |
| MSATmodel_category=specialised2023.05 | 0.105 | 0.275 | — | — | 0.41 | 0.246 | 0.157 | 0.14 | 0.286 | |
| R2Genmodel_category=generalist, optimized_on_merged_training_dataset=true, training_batch_size=162023.05 | 0.104 | 0.28 | — | — | 0.386 | 0.238 | 0.154 | 0.144 | 0.297 | |
| R2GenCMNModel category=specialized, Batch size (bs)=162023.05 | 0.102 | 0.161 | 0.54 | 0.505 | — | — | — | — | — | |
| R2GenCMNmodel_category=specialised2023.05 | 0.102 | 0.161 | — | — | 0.361 | 0.231 | 0.151 | 0.135 | 0.31 | |
| R2GenModel category=generalist, Batch size (bs)=1922023.05 | 0.1 | 0.271 | 0.561 | 0.549 | — | — | — | — | — | |
| R2Genmodel_category=generalist, optimized_on_merged_training_dataset=true, training_batch_size=1922023.05 | 0.1 | 0.271 | — | — | 0.397 | 0.24 | 0.151 | 0.153 | 0.296 | |
| R2Genmodel_category=generalist, optimized_on_merged_training_dataset=true, training_batch_size=962023.05 | 0.097 | 0.271 | — | — | 0.407 | 0.244 | 0.15 | 0.155 | 0.297 |