Image Classification on RSNA (test)
91AUCMammo-CLIP
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Mammo-CLIPBackbone=EN-B5, Pre-training Data=UPMC, VinDr, Evaluation Protocol=Finetune, Training Data Fraction=100%2024.05 | 91 | — | |
| EGMAPortion of training data=100%, Evaluation protocol=Linear classification2024.03 | 90.1 | — | |
| Mammo-CLIPBackbone=EN-B5, Pre-training Data=UPMC, Evaluation Protocol=Finetune, Training Data Fraction=100%2024.05 | 90 | — | |
| Mammo-CLIPBackbone=EN-B5, Pre-training Data=UPMC, VinDr, Evaluation Protocol=Finetune, Training Data Fraction=50%2024.05 | 90 | — | |
| EGMAPortion of training data=10%, Evaluation protocol=Linear classification2024.03 | 89.4 | — | |
| MedKLIPPortion of training data=100%, Evaluation protocol=Linear classification2024.03 | 89.31 | — | |
| MGCAPortion of training data=100%, Evaluation protocol=Linear classification2024.03 | 89.24 | — | |
| PRIORPortion of training data=100%, Evaluation protocol=Linear classification2024.03 | 89.19 | — | |
| MedCLIPPortion of training data=100%, Evaluation protocol=Linear classification2024.03 | 89.1 | — | |
| Mammo-CLIPBackbone=EN-B2, Pre-training Data=UPMC, Evaluation Protocol=Finetune, Training Data Fraction=100%2024.05 | 89 | — | |
| Mammo-CLIPBackbone=EN-B5, Pre-training Data=UPMC, Evaluation Protocol=Finetune, Training Data Fraction=50%2024.05 | 89 | — | |
| BioViLPortion of training data=100%, Evaluation protocol=Linear classification2024.03 | 88.64 | — | |
| ConVIRTPortion of training data=100%, Evaluation protocol=Linear classification2024.03 | 88.6 | — | |
| GLORIAPortion of training data=100%, Evaluation protocol=Linear classification2024.03 | 88.6 | — | |
| EGMAPortion of training data=1%, Evaluation protocol=Linear classification2024.03 | 88.41 | — | |
| MedCLIPPortion of training data=10%, Evaluation protocol=Linear classification2024.03 | 88.19 | — | |
| PRIORPortion of training data=10%, Evaluation protocol=Linear classification2024.03 | 88.07 | — | |
| GLORIAPortion of training data=10%, Evaluation protocol=Linear classification2024.03 | 88 | — | |
| MedKLIPPortion of training data=10%, Evaluation protocol=Linear classification2024.03 | 87.99 | — | |
| MedCLIPPortion of training data=1%, Evaluation protocol=Linear classification2024.03 | 87.61 | — | |
| MGCAPortion of training data=10%, Evaluation protocol=Linear classification2024.03 | 87.54 | — | |
| MedKLIPPortion of training data=1%, Evaluation protocol=Linear classification2024.03 | 87.31 | — | |
| ACE-LoRAEvaluation Mode=Zero-shot2026.03 | 87.19 | 79.54 | |
| PRIORPortion of training data=1%, Evaluation protocol=Linear classification2024.03 | 86.72 | — | |
| GLORIAPortion of training data=1%, Evaluation protocol=Linear classification2024.03 | 86.1 | — | |
| CLIPBackbone=EN-B5, Pre-training Data=UPMC, Evaluation Protocol=Finetune, Training Data Fraction=100%2024.05 | 86 | — | |
| Mammo-CLIPBackbone=EN-B2, Pre-training Data=UPMC, Evaluation Protocol=Finetune, Training Data Fraction=50%2024.05 | 86 | — | |
| BioViLPortion of training data=10%, Evaluation protocol=Linear classification2024.03 | 85.68 | — | |
| MGCAPortion of training data=1%, Evaluation protocol=Linear classification2024.03 | 85.22 | — | |
| Mammo-CLIPBackbone=EN-B5, Pre-training Data=UPMC, Evaluation Protocol=Finetune, Training Data Fraction=10%2024.05 | 85 | — | |
| Mammo-CLIPBackbone=EN-B5, Pre-training Data=UPMC, VinDr, Evaluation Protocol=Finetune, Training Data Fraction=10%2024.05 | 85 | — | |
| CLIPBackbone=EN-B5, Pre-training Data=UPMC, Evaluation Protocol=Finetune, Training Data Fraction=50%2024.05 | 84 | — | |
| Mammo-CLIPBackbone=EN-B2, Pre-training Data=UPMC, Evaluation Protocol=Finetune, Training Data Fraction=10%2024.05 | 82 | — | |
| BioViLPortion of training data=1%, Evaluation protocol=Linear classification2024.03 | 81.76 | — | |
| BiomedCLIPCategory=Generalist Medical VLM, Evaluation Mode=Zero-shot2026.03 | 81.14 | 74.34 | |
| ConVIRTPortion of training data=10%, Evaluation protocol=Linear classification2024.03 | 80.1 | — | |
| CLIPBackbone=EN-B5, Pre-training Data=UPMC, Evaluation Protocol=Finetune, Training Data Fraction=10%2024.05 | 80 | — | |
| Mammo-CLIPBackbone=EN-B5, Pre-training Data=UPMC, VinDr, Evaluation Protocol=Linear Probe, Training Data Fraction=100%2024.05 | 79 | — | |
| ConVIRTPortion of training data=1%, Evaluation protocol=Linear classification2024.03 | 77.4 | — | |
| GLoRIACategory=Specialist Medical VLM, Evaluation Mode=Zero-shot2026.03 | 76.73 | 68.42 | |
| Mammo-CLIPBackbone=EN-B5, Pre-training Data=UPMC, Evaluation Protocol=Linear Probe, Training Data Fraction=100%2024.05 | 75 | — | |
| CLIPBackbone=RN-50, Pre-training Data=UPMC, Evaluation Protocol=Finetune, Training Data Fraction=100%2024.05 | 72 | — | |
| Mammo-CLIPBackbone=EN-B2, Pre-training Data=UPMC, Evaluation Protocol=Linear Probe, Training Data Fraction=100%2024.05 | 72 | — | |
| CLIPBackbone=EN-B5, Pre-training Data=UPMC, Evaluation Protocol=Linear Probe, Training Data Fraction=100%2024.05 | 70 | — | |
| MGCACategory=Specialist Medical VLM, Evaluation Mode=Zero-shot2026.03 | 68.21 | 63.75 | |
| CLIPBackbone=RN-50, Pre-training Data=UPMC, Evaluation Protocol=Finetune, Training Data Fraction=50%2024.05 | 67 | — | |
| KADCategory=Specialist Medical VLM, Evaluation Mode=Zero-shot2026.03 | 66.75 | 70.17 | |
| PMC-CLIPCategory=Generalist Medical VLM, Evaluation Mode=Zero-shot2026.03 | 64.59 | 60.93 | |
| PRIORCategory=Specialist Medical VLM, Evaluation Mode=Zero-shot2026.03 | 62.71 | 60.33 | |
| BioVILCategory=Specialist Medical VLM, Evaluation Mode=Zero-shot2026.03 | 62.23 | 56.66 | |
| CLIPBackbone=RN-50, Pre-training Data=UPMC, Evaluation Protocol=Finetune, Training Data Fraction=10%2024.05 | 62 | — | |
| Mammo-CLIPBackbone=EN-B5, Pre-training Data=UPMC, Evaluation Protocol=Zero-shot, Training Data Fraction=100%2024.05 | 62 | — | |
| Mammo-CLIPBackbone=EN-B2, Pre-training Data=UPMC, Evaluation Protocol=Zero-shot, Training Data Fraction=100%2024.05 | 60 | — | |
| Mammo-CLIPBackbone=EN-B5, Pre-training Data=UPMC, VinDr, Evaluation Protocol=Zero-shot, Training Data Fraction=100%2024.05 | 60 | — | |
| CLIPBackbone=RN-50, Pre-training Data=UPMC, Evaluation Protocol=Linear Probe, Training Data Fraction=100%2024.05 | 58 | — | |
| BMC-CLIPCategory=Generalist Medical VLM, Evaluation Mode=Zero-shot2026.03 | 56.18 | 53.83 | |
| ConVIRTCategory=Specialist Medical VLM, Evaluation Mode=Zero-shot2026.03 | 42.13 | 42.64 | |
| CLIPBackbone=EN-B5, Pre-training Data=UPMC, Evaluation Protocol=Zero-shot, Training Data Fraction=100%2024.05 | 42 | — | |
| CLIPBackbone=RN-50, Pre-training Data=UPMC, Evaluation Protocol=Zero-shot, Training Data Fraction=100%2024.05 | 28 | — |