Medical Image-Text Classification on Medical Specialties
44.13Ophthalmology PerformanceCHIPS
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| CHIPSRetention ratio (r)=20%, Backbone=MetaCLIP-B16-400M2025.11 | 44.13 | 13.02 | 11.87 | 22.49 | 40.79 | 38.54 | 5.92 | 30.36 | 28.2 | |
| TRAKRetention ratio (r)=20%, Backbone=MetaCLIP-B16-400M2025.11 | 43.25 | 10.12 | 11.02 | 16.75 | 37.66 | 28.83 | 5.41 | 28.16 | 24.54 | |
| TracInRetention ratio (r)=20%, Backbone=MetaCLIP-B16-400M2025.11 | 42.47 | 12.28 | 11.82 | 19.7 | 37.92 | 46.13 | 5.07 | 19.17 | 26.63 | |
| DotRetention ratio (r)=10%, Backbone=MetaCLIP-B16-400M2025.11 | 42.01 | 8.54 | 12.17 | 16.87 | 36.98 | 45.49 | 4.16 | 23.51 | 25.32 | |
| CHIPSRetention ratio (r)=30%, Backbone=MetaCLIP-B16-400M2025.11 | 41.66 | 13.56 | 11.37 | 25.02 | 43.1 | 46.53 | 7.69 | 36.34 | 29.96 | |
| TracInRetention ratio (r)=10%, Backbone=MetaCLIP-B16-400M2025.11 | 41.3 | 10.47 | 12.02 | 16.69 | 35.69 | 51.79 | 4.96 | 26.34 | 26.46 | |
| TracInRetention ratio (r)=30%, Backbone=MetaCLIP-B16-400M2025.11 | 39.63 | 14.18 | 11.97 | 14.24 | 38.91 | 41.09 | 5.69 | 22.19 | 25.68 | |
| DotRetention ratio (r)=20%, Backbone=MetaCLIP-B16-400M2025.11 | 39.2 | 11.19 | 11.77 | 13.3 | 35.46 | 53.72 | 5.38 | 33.63 | 26.39 | |
| TRAKRetention ratio (r)=30%, Backbone=MetaCLIP-B16-400M2025.11 | 38.95 | 10.49 | 11.42 | 16.92 | 36.96 | 25.7 | 7.75 | 25.14 | 23.54 | |
| CHIPSRetention ratio (r)=10%, Backbone=MetaCLIP-B16-400M2025.11 | 38.93 | 11.05 | 11.87 | 21.43 | 37.99 | 50.22 | 5.29 | 25.96 | 27.03 | |
| BMCLIP2025.11 | 38.47 | 17.44 | 61.65 | 9.44 | 49.75 | 38.26 | 5.02 | 17.28 | 29.86 | |
| DotRetention ratio (r)=30%, Backbone=MetaCLIP-B16-400M2025.11 | 38.42 | 11.05 | 11.62 | 15.4 | 37.52 | 35.04 | 7.69 | 20.74 | 23.97 | |
| RandomRetention ratio (r)=30%, Backbone=MetaCLIP-B16-400M2025.11 | 36.77 | 11.9 | 12.07 | 18.42 | 43.35 | 47.08 | 6.42 | 10.94 | 26.28 | |
| RandomRetention ratio (r)=10%, Backbone=MetaCLIP-B16-400M2025.11 | 36.01 | 9.93 | 11.27 | 20.61 | 39.71 | 43.96 | 4.68 | 10.18 | 24.78 | |
| PubMedCLIP2025.11 | 35.92 | 20.27 | 9.63 | 8.45 | 25.77 | 60.5 | 8.45 | 25.27 | 26.21 | |
| RandomRetention ratio (r)=20%, Backbone=MetaCLIP-B16-400M2025.11 | 35.79 | 13.82 | 11.62 | 21.92 | 39.35 | 36.41 | 6.6 | 11.13 | 25 | |
| RandomRetention ratio (r)=50%, Backbone=MetaCLIP-B16-400M2025.11 | 34.47 | 13.86 | 11.82 | 18.82 | 45.82 | 41 | 10.06 | 10.56 | 26.26 | |
| Full DatasetBackbone=MetaCLIP-B16-400M2025.11 | 33.3 | 12.75 | 11.72 | 23.33 | 49.57 | 82.79 | 12.4 | 9.81 | 31.51 | |
| Concept-BalanceRetention ratio (r)=10%, Backbone=MetaCLIP-B16-400M2025.11 | 33.18 | 12.11 | 11.67 | 21.81 | 40.4 | 46.82 | 5.03 | 10.87 | 25.5 | |
| Concept-BalanceRetention ratio (r)=20%, Backbone=MetaCLIP-B16-400M2025.11 | 32.77 | 13.62 | 11.97 | 24 | 44.24 | 43.16 | 5.42 | 10.37 | 26.2 | |
| Concept-FilterRetention ratio (r)=30%, Backbone=MetaCLIP-B16-400M2025.11 | 32.37 | 11.23 | 12.02 | 25.96 | 41.4 | 41.02 | 6.81 | 21.06 | 25.37 | |
| Concept-BalanceRetention ratio (r)=30%, Backbone=MetaCLIP-B16-400M2025.11 | 31.95 | 11.88 | 12.07 | 24.61 | 42.52 | 35.88 | 6.48 | 10.43 | 24.56 | |
| Concept-FilterRetention ratio (r)=10%, Backbone=MetaCLIP-B16-400M2025.11 | 31.4 | 10.81 | 11.72 | 23.41 | 43.14 | 44.53 | 5.14 | 11.06 | 25.15 | |
| Concept-FilterRetention ratio (r)=20%, Backbone=MetaCLIP-B16-400M2025.11 | 31.36 | 11.7 | 11.97 | 25.46 | 44.98 | 35.85 | 6.42 | 15.21 | 25.23 | |
| TRAKRetention ratio (r)=10%, Backbone=MetaCLIP-B16-400M2025.11 | 30.29 | 12.37 | 12.17 | 25.93 | 39.04 | 45.95 | 4.46 | 12.88 | 25.19 | |
| CLIPScoreRetention ratio (r)=30%, Backbone=MetaCLIP-B16-400M2025.11 | 21.93 | 8.25 | 11.32 | 13.94 | 38.81 | 26.49 | 4.49 | 11.94 | 19.01 | |
| CLIPScoreRetention ratio (r)=20%, Backbone=MetaCLIP-B16-400M2025.11 | 17.33 | 9.83 | 11.27 | 18.82 | 38.01 | 32.35 | 4.45 | 11.25 | 20.01 | |
| VanillaBackbone=MetaCLIP-B16-400M2025.11 | 15.91 | 19.76 | 10.82 | 17.95 | 30.09 | 57.96 | 5.24 | 10.56 | 23.51 | |
| CLIPScoreRetention ratio (r)=10%, Backbone=MetaCLIP-B16-400M2025.11 | 15.48 | 12.75 | 11.47 | 20.99 | 38.23 | 64.15 | 5.25 | 10.56 | 24.16 | |
| BioMedCLIP2025.11 | 14.42 | 15.59 | 1.2 | 10.14 | 21.17 | 44.79 | 4.66 | 72.91 | 21.45 |