Evaluation of metrics' alignment with human judgment on RadEvalX
0.927Spearman CorrelationAgentsEval
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| AgentsEval2026.01 | 0.927 | 1.867 | — | — | |
| Agent(det)2026.01 | 0.919 | 1.728 | — | — | |
| Agent(sim)2026.01 | 0.9 | 1.181 | — | — | |
| B-Score2026.01 | 0.789 | 0.909 | — | — | |
| ROUGE-12026.01 | 0.65 | 4.412 | — | — | |
| QAScore2026.06 | 0.4612 | — | 0.4507 | 0.391 | |
| METEOR2026.01 | 0.452 | 5.004 | — | — | |
| GREEN2026.06 | 0.4022 | — | 0.4194 | 0.3148 | |
| CheXbert2026.06 | 0.3779 | — | 0.387 | 0.2896 | |
| CHRF2026.01 | 0.357 | 4.86 | — | — | |
| RaTEScore2026.06 | 0.3551 | — | 0.3539 | 0.2651 | |
| BERTScore2026.06 | 0.2525 | — | 0.2575 | 0.1901 | |
| RadCliQ2026.06 | 0.2153 | — | 0.2017 | 0.1586 | |
| BLEU-22026.06 | 0.1742 | — | 0.1851 | 0.1265 | |
| BLEU2026.01 | 0.17 | 8.155 | — | — | |
| RadGraph F12026.06 | 0.1692 | — | 0.1743 | 0.1238 | |
| BLEU-42026.06 | 0.0964 | — | 0.119 | 0.0728 |