Radiology report discrepancy evaluation on RadEvalX 100-pair
0.715Spearman Correlation (Total)RadOT-Eval
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| RadOT-Evalvariant=full2026.06 | 0.715 | 0.548 | 0.399 | |
| RadOT-Evalvariant=w/o ref count2026.06 | 0.712 | 0.548 | 0.308 | |
| Structured monotone2026.06 | 0.612 | 0.398 | 0.256 | |
| GNN discrepancy model2026.06 | 0.607 | 0.398 | 0.119 | |
| Text-only ridge2026.06 | 0.592 | 0.337 | 0.324 | |
| GREEN risk2026.06 | 0.57 | 0.433 | 0.141 | |
| Graph-derived monotone2026.06 | 0.569 | 0.469 | 0.206 | |
| CheXbert2026.06 | 0.492 | 0.413 | 0.103 | |
| Reference count only2026.06 | 0.474 | 0.201 | 0.41 | |
| BERTScore2026.06 | 0.349 | 0.195 | 0.151 | |
| RadCliQ2026.06 | 0.335 | 0.188 | 0.177 | |
| GREEN native count2026.06 | 0.296 | 0.382 | — | |
| BLEU-22026.06 | 0.292 | 0.162 | 0.157 | |
| RadGraph-F12026.06 | 0.285 | 0.159 | 0.147 | |
| BLEU-42026.06 | 0.108 | 0.096 | 0.046 |