Pathology report generation on PathText BRCA (test)
0.4598BLEU-1RANGER
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| RANGER2026.03 | 0.4598 | 0.3044 | 0.2036 | 0.1435 | 0.1883 | 0.3038 | — | — | — | — | |
| BiGen2025.06 | 0.45 | 0.296 | 0.196 | 0.135 | 0.18 | 0.293 | 0.521 | 0.657 | 0.821 | 0.73 | |
| BiGen2026.03 | 0.45 | 0.296 | 0.196 | 0.135 | 0.18 | 0.293 | — | — | — | — | |
| OursVisual Extractor=ViT, Pre-train=HIPT2023.11 | 0.446 | 0.286 | 0.183 | 0.12 | 0.171 | 0.271 | 0.532 | — | — | — | |
| HistGen2025.06 | 0.422 | 0.272 | 0.177 | 0.118 | 0.169 | 0.277 | 0.493 | 0.514 | 0.643 | 0.571 | |
| HistGen2026.03 | 0.422 | 0.272 | 0.177 | 0.118 | 0.169 | 0.277 | — | — | — | — | |
| MI-Gen2025.06 | 0.416 | 0.267 | 0.174 | 0.115 | 0.165 | 0.27 | 0.49 | 0.257 | 0.529 | 0.346 | |
| MI-Gen2026.03 | 0.416 | 0.267 | 0.174 | 0.115 | 0.165 | 0.27 | — | — | — | — | |
| OursVisual Extractor=ResNet, Pre-train=ImageNet2023.11 | 0.403 | 0.254 | 0.168 | 0.117 | 0.163 | 0.28 | 0.498 | — | — | — | |
| R2GenCMN2025.06 | 0.396 | 0.254 | 0.164 | 0.11 | 0.163 | 0.279 | 0.47 | 0.429 | 0.682 | 0.526 | |
| R2GenCMN2026.03 | 0.396 | 0.254 | 0.164 | 0.11 | 0.163 | 0.279 | — | — | — | — | |
| vanilla TransformerVisual Extractor=ResNet, Pre-train=ImageNet2023.11 | 0.395 | 0.23 | 0.135 | 0.089 | 0.145 | 0.254 | 0.453 | — | — | — | |
| vanilla Transformer2025.06 | 0.389 | 0.246 | 0.157 | 0.103 | 0.158 | 0.257 | 0.487 | 0.457 | 0.8 | 0.582 | |
| Vanilla Transformer2026.03 | 0.389 | 0.246 | 0.157 | 0.103 | 0.158 | 0.257 | — | — | — | — | |
| vanilla TransformerVisual Extractor=ViT, Pre-train=HIPT2023.11 | 0.383 | 0.237 | 0.151 | 0.096 | 0.152 | 0.264 | 0.488 | — | — | — | |
| OursVisual Extractor=ViT, Pre-train=ImageNet2023.11 | 0.38 | 0.252 | 0.169 | 0.11 | 0.157 | 0.279 | 0.474 | — | — | — | |
| R2Gen2025.06 | 0.378 | 0.243 | 0.16 | 0.107 | 0.179 | 0.279 | 0.505 | 0.486 | 0.63 | 0.548 | |
| R2Gen2026.03 | 0.378 | 0.243 | 0.16 | 0.107 | 0.179 | 0.279 | — | — | — | — | |
| att-LSTMVisual Extractor=ViT, Pre-train=HIPT2023.11 | 0.372 | 0.23 | 0.135 | 0.09 | 0.15 | 0.269 | 0.466 | — | — | — | |
| CNN-RNN2025.06 | 0.371 | 0.185 | 0.089 | 0.043 | 0.143 | 0.239 | 0.478 | 0.429 | 0.75 | 0.546 | |
| att-LSTM2025.06 | 0.371 | 0.191 | 0.094 | 0.048 | 0.142 | 0.238 | 0.46 | 0.6 | 0.636 | 0.618 | |
| CNN-RNN2026.03 | 0.371 | 0.185 | 0.089 | 0.043 | 0.143 | 0.239 | — | — | — | — | |
| att-LSTM2026.03 | 0.371 | 0.191 | 0.094 | 0.048 | 0.142 | 0.238 | — | — | — | — | |
| att-LSTMVisual Extractor=ResNet, Pre-train=ImageNet2023.11 | 0.367 | 0.234 | 0.128 | 0.085 | 0.151 | 0.262 | 0.442 | — | — | — | |
| vanilla TransformerVisual Extractor=ViT, Pre-train=ImageNet2023.11 | 0.346 | 0.216 | 0.137 | 0.091 | 0.149 | 0.273 | 0.443 | — | — | — | |
| Mem-TransformerVisual Extractor=ViT, Pre-train=HIPT2023.11 | 0.344 | 0.218 | 0.15 | 0.103 | 0.151 | 0.268 | 0.501 | — | — | — | |
| CNN-RNNVisual Extractor=ViT, Pre-train=HIPT2023.11 | 0.342 | 0.215 | 0.141 | 0.084 | 0.148 | 0.26 | 0.403 | — | — | — | |
| att-LSTMVisual Extractor=ViT, Pre-train=ImageNet2023.11 | 0.341 | 0.211 | 0.132 | 0.083 | 0.145 | 0.265 | 0.425 | — | — | — | |
| CNN-RNNVisual Extractor=ResNet, Pre-train=ImageNet2023.11 | 0.334 | 0.209 | 0.122 | 0.074 | 0.137 | 0.248 | 0.396 | — | — | — | |
| Mem-TransformerVisual Extractor=ViT, Pre-train=ImageNet2023.11 | 0.332 | 0.216 | 0.144 | 0.1 | 0.147 | 0.268 | 0.449 | — | — | — | |
| CNN-RNNVisual Extractor=ViT, Pre-train=ImageNet2023.11 | 0.328 | 0.201 | 0.127 | 0.082 | 0.142 | 0.253 | 0.38 | — | — | — | |
| Mem-TransformerVisual Extractor=ResNet, Pre-train=ImageNet2023.11 | 0.317 | 0.207 | 0.136 | 0.091 | 0.129 | 0.27 | 0.467 | — | — | — |