Thoracic Disease Classification on ChestX-ray14
85.9AUCMRM
Evaluation results
| Method | Links | |||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| MRMDirect Inference=No, Labeling ratio=100%2026.06 | 85.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| REFERSDirect Inference=No, Labeling ratio=100%2026.06 | 84.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| IMT-CXRDirect Inference=Yes, Labeling ratio=100%2026.06 | 84.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MRMDirect Inference=No, Labeling ratio=10%2026.06 | 84 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MedKLIPDirect Inference=Yes, Labeling ratio=100%2026.06 | 83.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BioViLDirect Inference=Yes, Labeling ratio=100%2026.06 | 82.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Medical MAEDirect Inference=No, Labeling ratio=100%2026.06 | 82.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| IMT-CXRDirect Inference=Yes, Labeling ratio=10%2026.06 | 82 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GloRIADirect Inference=Yes, Labeling ratio=100%2026.06 | 81.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ConVIRTDirect Inference=Yes, Labeling ratio=100%2026.06 | 81.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| KEPILZero-shot=true2026.05 | 80.95 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 83.23 | — | — | 34.74 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| REFERSDirect Inference=No, Labeling ratio=10%2026.06 | 80.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CARZeroZero-shot=true2026.05 | 79.64 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 79.6 | — | — | 31.41 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MRMDirect Inference=No, Labeling ratio=1%2026.06 | 79.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| IMT-CXRDirect Inference=Yes, Labeling ratio=1%2026.06 | 79.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MedKLIPDirect Inference=Yes, Labeling ratio=10%2026.06 | 78.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DeViDeZero-shot=true2026.05 | 77.61 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 82.06 | — | — | 31.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MedKLIPDirect Inference=Yes, Labeling ratio=1%2026.06 | 77.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| REFERSDirect Inference=No, Labeling ratio=1%2026.06 | 76.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ConVIRTDirect Inference=Yes, Labeling ratio=10%2026.06 | 76.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| KADZero-shot=true2026.05 | 76.49 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 80.49 | — | — | 29.98 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GloRIADirect Inference=Yes, Labeling ratio=10%2026.06 | 76.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BioViLDirect Inference=Yes, Labeling ratio=10%2026.06 | 75.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| IMT-CXRSetting=direct inference2026.06 | 74.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 27.1 | 74.2 | 75.9 | 79.7 | 60.8 | 77.9 | 69.6 | 68.7 | 82.6 | 70.9 | 80 | 72.8 | 63.8 | 74.9 | 88.4 | 37.4 | 21.9 | 45.5 | 44.4 | 30.7 | 20 | 8.3 | 45.7 | 23.8 | 22.9 | 16 | 8.8 | 20.6 | 34.1 | |
| MAVLZero-shot=true2026.05 | 73.57 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 82.77 | — | — | 26.25 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MedKLIPSetting=direct inference2026.06 | 72.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 24.3 | 65.3 | 84.9 | 82.3 | 68.2 | 74.6 | 64.2 | 69.9 | 79.4 | 70.2 | 79.3 | 79.6 | 58.6 | 51.2 | 85.9 | 28.3 | 31.4 | 50.8 | 48.9 | 24.1 | 17.5 | 7.2 | 42.1 | 21.4 | 19.1 | 24.1 | 7.3 | 1.4 | 16.3 | |
| MedKLIPZero-shot=true2026.05 | 72.33 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 79.4 | — | — | 24.18 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BioViLDirect Inference=Yes, Labeling ratio=1%2026.06 | 69.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GloRIADirect Inference=Yes, Labeling ratio=1%2026.06 | 67.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CheXzeroZero-shot=true2026.05 | 66.99 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 65.38 | — | — | 19.95 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ConVIRTDirect Inference=Yes, Labeling ratio=1%2026.06 | 66.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BioViLSetting=direct inference2026.06 | 65.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 19.2 | 52.1 | 68.4 | 74.4 | 61.2 | 65.4 | 63.4 | 67.2 | 68.3 | 64.1 | 78.1 | 64.4 | 62 | 64.8 | 69 | 23.5 | 20.9 | 43.8 | 41.4 | 17.8 | 16.4 | 6.7 | 27.4 | 17.7 | 18.7 | 12.3 | 5.6 | 11.9 | 4.5 | |
| GLoRIASetting=direct inference2026.06 | 60.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 17.5 | 65.9 | 70.2 | 74.9 | 65.2 | 60.9 | 52.1 | 59.4 | 56.6 | 69.3 | 74.4 | 50.1 | 46.2 | 60.7 | 46 | 28.4 | 15.2 | 46.1 | 46.6 | 13.2 | 12.6 | 5.9 | 21.4 | 21.2 | 13.9 | 8.1 | 0.3 | 11.2 | 0.8 | |
| BioViL-TZero-shot=true2026.05 | 60.43 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 62.12 | — | — | 17.29 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BioViLZero-shot=true2026.05 | 57.82 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 61.33 | — | — | 15.64 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ConVIRTSetting=direct inference2026.06 | 56 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 13.4 | 45.1 | 44.3 | 63.2 | 65.1 | 61.6 | 57.2 | 63.6 | 54.1 | 63.7 | 70.2 | 41.9 | 47.4 | 56 | 51.2 | 0.6 | 0.4 | 36.4 | 43.4 | 15.5 | 14 | 5.8 | 20.3 | 17.5 | 12.3 | 8.1 | 3.2 | 9.9 | 0.5 | |
| GLoRIAZero-shot=true2026.05 | 55.92 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 59.47 | — | — | 14.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ConVIRTZero-shot=true2026.05 | 53.15 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 57.88 | — | — | 12.38 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| A3 Net2023.11 | — | 77.9 | 75.9 | 71 | 87.8 | 85.5 | 93.3 | 83.8 | 83.6 | 73.7 | 79.1 | 89.5 | 77.7 | 83.4 | 93.8 | 82.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CoAtNet (Ours)Architecture=Hybrid (Transformer + CNN)2023.11 | — | 82.313 | 80.98 | 73.105 | 89.66 | 90.185 | 92.067 | 81.574 | 88.203 | 76.093 | 80.053 | 90.788 | 79.828 | 86.191 | 88.305 | 84.239 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Ensemble (Ours)Type=Weighted Average Ensemble, Optimization=Differential Evolution2023.11 | — | 83.39 | 81.575 | 74.102 | 90.164 | 91.034 | 92.946 | 83.347 | 88.977 | 77.648 | 81.27 | 91.954 | 80.611 | 87.315 | 91.723 | 85.433 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GPT-4o# Params=Unknown, Expert Model=Excluded2024.11 | — | — | — | — | 19.7 | — | — | — | — | — | — | — | — | — | — | 33.1 | 2 | 77.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ImageGCN2023.11 | — | 80.2 | 79.6 | 70.2 | 90 | 88.3 | 91.5 | 82.5 | 87.4 | 71.5 | 79.1 | 89.4 | 76.8 | 84.3 | 94.3 | 83.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Li et al.2023.11 | — | 80 | 80 | 70 | 87 | 88 | 91 | 78 | 87 | 67 | 76 | 87 | 75 | 83 | 77 | 80.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Med-Gemini# Params=1.5T, Expert Model=Excluded2024.11 | — | — | — | — | 55.3 | — | — | — | — | — | — | — | — | — | — | 46.9 | 5.5 | 79.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Torch Xray Vision# Params=(ensemble), Expert Model=Included2024.11 | — | — | — | — | 50.4 | — | — | — | — | — | — | — | — | — | — | 50 | 11.6 | 87.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| VILA-M3-13B# Params=13B, Expert Model=Excluded2024.11 | — | — | — | — | 55.9 | — | — | — | — | — | — | — | — | — | — | 49.9 | 7.6 | 86.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| VILA-M3-13B# Params=13B, Expert Model=Included2024.11 | — | — | — | — | 51.5 | — | — | — | — | — | — | — | — | — | — | 51.2 | 13.6 | 88.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| VILA-M3-3B# Params=3B, Expert Model=Excluded2024.11 | — | — | — | — | 54.5 | — | — | — | — | — | — | — | — | — | — | 48.4 | 7 | 83.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| VILA-M3-3B# Params=3B, Expert Model=Included2024.11 | — | — | — | — | 55.2 | — | — | — | — | — | — | — | — | — | — | 51.3 | 10.8 | 88.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| VILA-M3-40B# Params=40B, Expert Model=Excluded2024.11 | — | — | — | — | 55.9 | — | — | — | — | — | — | — | — | — | — | 47.1 | 0 | 85.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| VILA-M3-40B# Params=40B, Expert Model=Included2024.11 | — | — | — | — | 53.9 | — | — | — | — | — | — | — | — | — | — | 51.3 | 11 | 89 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| VILA-M3-8B# Params=8B, Expert Model=Excluded2024.11 | — | — | — | — | 49.9 | — | — | — | — | — | — | — | — | — | — | 45.8 | 2.7 | 85 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| VILA-M3-8B# Params=8B, Expert Model=Included2024.11 | — | — | — | — | 53.5 | — | — | — | — | — | — | — | — | — | — | 50.8 | 14.4 | 84.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Wang et al.2023.11 | — | 71.6 | 70.8 | 60.9 | 80.6 | 83.5 | 81.5 | 76.9 | 78.4 | 63.3 | 70.8 | 80.7 | 67.1 | 70.6 | 76.7 | 73.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — |