Radiology Report Generation on Hip (test)
0.086BLEU-4X-RGen
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| X-RGenModel Category=specialized2023.05 | 0.086 | 0.356 | 0.216 | 0.135 | 0.138 | 0.294 | 0.192 | — | — | |
| R2GenModel Category=generalist, Optimized on merged training dataset=true, batch size=1922023.05 | 0.086 | 0.367 | 0.214 | 0.133 | 0.139 | 0.285 | 0.238 | — | — | |
| X-RGenModel category=specialized, Batch size (bs)=162023.05 | 0.086 | — | — | — | — | — | 0.192 | 52.2 | 50.2 | |
| X-RGenModel Category=generalist, batch size=962023.05 | 0.084 | 0.366 | 0.211 | 0.13 | 0.137 | 0.281 | 0.257 | — | — | |
| R2GenCMNModel Category=specialized2023.05 | 0.083 | 0.362 | 0.214 | 0.133 | 0.133 | 0.286 | 0.22 | — | — | |
| R2GenModel Category=specialized2023.05 | 0.082 | 0.358 | 0.211 | 0.131 | 0.131 | 0.288 | 0.21 | — | — | |
| MSATModel Category=specialized2023.05 | 0.081 | 0.362 | 0.218 | 0.131 | 0.125 | 0.282 | 0.235 | — | — | |
| R2GenModel Category=generalist, Optimized on merged training dataset=true, batch size=962023.05 | 0.08 | 0.361 | 0.209 | 0.126 | 0.137 | 0.281 | 0.226 | — | — | |
| TransformerModel Category=specialized2023.05 | 0.077 | 0.334 | 0.193 | 0.118 | 0.116 | 0.264 | 0.137 | — | — | |
| TransformerModel category=specialized, Batch size (bs)=162023.05 | 0.077 | — | — | — | — | — | 0.137 | 52.5 | 48.1 | |
| X-RGenModel Category=generalist, batch size=1922023.05 | 0.076 | 0.367 | 0.206 | 0.122 | 0.133 | 0.277 | 0.215 | — | — | |
| X-RGenModel category=generalist, Batch size (bs)=1922023.05 | 0.076 | — | — | — | — | — | 0.215 | 52.9 | 49.9 | |
| R2GenModel Category=generalist, Optimized on merged training dataset=true, batch size=162023.05 | 0.074 | 0.351 | 0.199 | 0.12 | 0.132 | 0.275 | 0.203 | — | — | |
| X-RGenModel Category=generalist, batch size=162023.05 | 0.073 | 0.332 | 0.187 | 0.113 | 0.129 | 0.263 | 0.184 | — | — |