Unconditional Image-to-Report Retrieval on MIMIC-IR Chest X-Ray
98.9Recall@5LLM2VEC4CXR
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| LLM2VEC4CXRParameters=8B2025.09 | 98.9 | 99.4 | — | — | — | — | — | — | 93.3 | |
| LLM2VEC4CXR+Parameters=1B2025.09 | 98.4 | 98.9 | — | — | — | — | — | — | 91.8 | |
| LLM2VEC4CXRParameters=1B2025.09 | 91.2 | 91.8 | — | — | — | — | — | — | 89.4 | |
| LLM2VECParameters=8B2025.09 | 82.3 | 87.1 | — | — | — | — | — | — | 70.3 | |
| BERT4CXR2025.09 | 82.1 | 87.5 | — | — | — | — | — | — | 78.6 | |
| LLM2VECParameters=1B2025.09 | 76.6 | 82.6 | — | — | — | — | — | — | 57.6 | |
| ClinicalBERT2025.09 | 71.1 | 76.7 | — | — | — | — | — | — | 54.6 | |
| BioClinicalBERT2025.09 | 69 | 74.3 | — | — | — | — | — | — | 54.3 | |
| Base-BERT2025.09 | 66.4 | 70.8 | — | — | — | — | — | — | 52 | |
| PubMedBERT2025.09 | 58.5 | 63.8 | — | — | — | — | — | — | 44.7 | |
| CXR-BERT-Specialized2025.09 | 53.7 | 60 | — | — | — | — | — | — | 39.5 | |
| RadIR-CXRRetrieval Type=Image-to-Text2025.03 | 4.33 | 6.88 | 18.18 | 25.34 | 69.07 | 45.76 | 17.21 | 11 | — | |
| BioMedCLIPRetrieval Type=Image-to-Text2025.03 | 0.47 | 0.78 | 4.23 | 8.1 | 62.79 | 41.6 | 15.64 | 9.99 | — | |
| PMC-CLIPRetrieval Type=Image-to-Text2025.03 | 0.31 | 0.44 | 2.73 | 5.43 | 50.96 | 35.18 | 13.99 | 9.06 | — | |
| MedCLIPRetrieval Type=Image-to-Text2025.03 | 0.19 | 0.28 | 2.04 | 3.77 | 58.22 | 38.58 | 14.51 | 9.27 | — |