Image Classification on CXR14
0.86AUCClean
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| CleanTarget Model=ViTB-CXR, Surrogate Model=DN121-IN2024.10 | 0.86 | — | — | |
| CleanTarget Model=ViTS-CXR, Surrogate Model=DN121-IN2024.10 | 0.85 | — | — | |
| CleanTarget Model=Avg, Surrogate Model=DN121-IN2024.10 | 0.82 | — | — | |
| BIMTarget Model=ViTS-CXR, Surrogate Model=DN121-IN2024.10 | 0.82 | — | — | |
| +AdmixTarget Model=ViTS-CXR, Surrogate Model=DN121-IN2024.10 | 0.82 | — | — | |
| +DITarget Model=ViTS-CXR, Surrogate Model=DN121-IN2024.10 | 0.8 | — | — | |
| G2DInference mode=Zero-shot2023.12 | 0.794 | 0.331 | 0.823 | |
| CleanTarget Model=DN121-CXR, Surrogate Model=DN121-IN2024.10 | 0.79 | — | — | |
| BIMTarget Model=ViTB-CXR, Surrogate Model=DN121-IN2024.10 | 0.79 | — | — | |
| +AdmixTarget Model=Avg, Surrogate Model=DN121-IN2024.10 | 0.79 | — | — | |
| KADInference mode=Zero-shot, Extra annotated data during pre-training=True2023.12 | 0.789 | 0.323 | 0.816 | |
| BIMTarget Model=Avg, Surrogate Model=DN121-IN2024.10 | 0.78 | — | — | |
| +AdmixTarget Model=ViTB-CXR, Surrogate Model=DN121-IN2024.10 | 0.78 | — | — | |
| +RDITarget Model=ViTS-CXR, Surrogate Model=DN121-IN2024.10 | 0.78 | — | — | |
| CleanTarget Model=RN50-IN, Surrogate Model=DN121-IN2024.10 | 0.77 | — | — | |
| BIMTarget Model=DN121-CXR, Surrogate Model=DN121-IN2024.10 | 0.77 | — | — | |
| +AdmixTarget Model=DN121-CXR, Surrogate Model=DN121-IN2024.10 | 0.77 | — | — | |
| +AdmixTarget Model=RN50-IN, Surrogate Model=DN121-IN2024.10 | 0.77 | — | — | |
| +SITarget Model=ViTS-CXR, Surrogate Model=DN121-IN2024.10 | 0.77 | — | — | |
| +DITarget Model=ViTB-CXR, Surrogate Model=DN121-IN2024.10 | 0.76 | — | — | |
| BIMTarget Model=RN50-IN, Surrogate Model=DN121-IN2024.10 | 0.75 | — | — | |
| +SITarget Model=ViTB-CXR, Surrogate Model=DN121-IN2024.10 | 0.74 | — | — | |
| +SSATarget Model=ViTS-CXR, Surrogate Model=DN121-IN2024.10 | 0.74 | — | — | |
| +DITarget Model=Avg, Surrogate Model=DN121-IN2024.10 | 0.74 | — | — | |
| +RDITarget Model=ViTB-CXR, Surrogate Model=DN121-IN2024.10 | 0.74 | — | — | |
| MedKLIPInference mode=Zero-shot, Extra annotated data during pre-training=True2023.12 | 0.726 | 0.244 | 0.796 | |
| +DITarget Model=RN50-IN, Surrogate Model=DN121-IN2024.10 | 0.72 | — | — | |
| +RDITarget Model=RN50-IN, Surrogate Model=DN121-IN2024.10 | 0.72 | — | — | |
| +SIATarget Model=ViTS-CXR, Surrogate Model=DN121-IN2024.10 | 0.72 | — | — | |
| +DeCoWATarget Model=ViTS-CXR, Surrogate Model=DN121-IN2024.10 | 0.72 | — | — | |
| +BSRTarget Model=ViTS-CXR, Surrogate Model=DN121-IN2024.10 | 0.72 | — | — | |
| +SSATarget Model=ViTB-CXR, Surrogate Model=DN121-IN2024.10 | 0.71 | — | — | |
| +RDITarget Model=Avg, Surrogate Model=DN121-IN2024.10 | 0.71 | — | — | |
| +SITarget Model=Avg, Surrogate Model=DN121-IN2024.10 | 0.7 | — | — | |
| +ODITarget Model=ViTS-CXR, Surrogate Model=DN121-IN2024.10 | 0.7 | — | — | |
| +T-AugTarget Model=ViTS-CXR, Surrogate Model=DN121-IN2024.10 | 0.7 | — | — | |
| +SITarget Model=RN50-IN, Surrogate Model=DN121-IN2024.10 | 0.69 | — | — | |
| +DITarget Model=DN121-CXR, Surrogate Model=DN121-IN2024.10 | 0.69 | — | — | |
| +H-AugTarget Model=ViTS-CXR, Surrogate Model=DN121-IN2024.10 | 0.68 | — | — | |
| +S4STTarget Model=ViTS-CXR, Surrogate Model=DN121-IN2024.10 | 0.68 | — | — | |
| +DeCoWATarget Model=ViTB-CXR, Surrogate Model=DN121-IN2024.10 | 0.67 | — | — | |
| BioViLInference mode=Zero-shot2023.12 | 0.662 | 0.662 | 0.633 | |
| +SSATarget Model=Avg, Surrogate Model=DN121-IN2024.10 | 0.66 | — | — | |
| +SIATarget Model=ViTB-CXR, Surrogate Model=DN121-IN2024.10 | 0.66 | — | — | |
| +BSRTarget Model=ViTB-CXR, Surrogate Model=DN121-IN2024.10 | 0.66 | — | — | |
| FedBBnumber of clients=100, participant rate=0.05, delta=12026.06 | 0.6487 | — | — | |
| +T-AugTarget Model=ViTB-CXR, Surrogate Model=DN121-IN2024.10 | 0.64 | — | — | |
| +ODITarget Model=ViTB-CXR, Surrogate Model=DN121-IN2024.10 | 0.63 | — | — | |
| +H-AugTarget Model=ViTB-CXR, Surrogate Model=DN121-IN2024.10 | 0.62 | — | — | |
| FedAlignnumber of clients=100, participant rate=0.05, delta=12026.06 | 0.6194 | — | — | |
| GLoRIAInference mode=Zero-shot2023.12 | 0.61 | 0.174 | 0.503 | |
| +RDITarget Model=DN121-CXR, Surrogate Model=DN121-IN2024.10 | 0.61 | — | — | |
| +DeCoWATarget Model=Avg, Surrogate Model=DN121-IN2024.10 | 0.61 | — | — | |
| +S4STTarget Model=ViTB-CXR, Surrogate Model=DN121-IN2024.10 | 0.61 | — | — | |
| +SSATarget Model=DN121-CXR, Surrogate Model=DN121-IN2024.10 | 0.6 | — | — | |
| +SSATarget Model=RN50-IN, Surrogate Model=DN121-IN2024.10 | 0.59 | — | — | |
| +T-AugTarget Model=Avg, Surrogate Model=DN121-IN2024.10 | 0.59 | — | — | |
| +SITarget Model=DN121-CXR, Surrogate Model=DN121-IN2024.10 | 0.58 | — | — | |
| +ODITarget Model=Avg, Surrogate Model=DN121-IN2024.10 | 0.58 | — | — | |
| +BSRTarget Model=Avg, Surrogate Model=DN121-IN2024.10 | 0.58 | — | — | |
| FedProxnumber of clients=100, participant rate=0.05, delta=12026.06 | 0.5746 | — | — | |
| MOONnumber of clients=100, participant rate=0.05, delta=12026.06 | 0.5728 | — | — | |
| FedNovanumber of clients=100, participant rate=0.05, delta=12026.06 | 0.5725 | — | — | |
| FedAvgnumber of clients=100, participant rate=0.05, delta=12026.06 | 0.5714 | — | — | |
| +SIATarget Model=Avg, Surrogate Model=DN121-IN2024.10 | 0.57 | — | — | |
| ConVIRTInference mode=Zero-shot2023.12 | 0.56 | 0.135 | 0.459 | |
| +DeCoWATarget Model=RN50-IN, Surrogate Model=DN121-IN2024.10 | 0.56 | — | — | |
| +ODITarget Model=RN50-IN, Surrogate Model=DN121-IN2024.10 | 0.54 | — | — | |
| +T-AugTarget Model=RN50-IN, Surrogate Model=DN121-IN2024.10 | 0.53 | — | — | |
| +H-AugTarget Model=DN121-CXR, Surrogate Model=DN121-IN2024.10 | 0.53 | — | — | |
| +H-AugTarget Model=Avg, Surrogate Model=DN121-IN2024.10 | 0.53 | — | — | |
| +SIATarget Model=RN50-IN, Surrogate Model=DN121-IN2024.10 | 0.52 | — | — | |
| +BSRTarget Model=RN50-IN, Surrogate Model=DN121-IN2024.10 | 0.51 | — | — | |
| +S4STTarget Model=Avg, Surrogate Model=DN121-IN2024.10 | 0.51 | — | — | |
| +DeCoWATarget Model=DN121-CXR, Surrogate Model=DN121-IN2024.10 | 0.49 | — | — | |
| +T-AugTarget Model=DN121-CXR, Surrogate Model=DN121-IN2024.10 | 0.49 | — | — | |
| +ODITarget Model=DN121-CXR, Surrogate Model=DN121-IN2024.10 | 0.46 | — | — | |
| +H-AugTarget Model=RN50-IN, Surrogate Model=DN121-IN2024.10 | 0.45 | — | — | |
| +BSRTarget Model=DN121-CXR, Surrogate Model=DN121-IN2024.10 | 0.44 | — | — | |
| +SIATarget Model=DN121-CXR, Surrogate Model=DN121-IN2024.10 | 0.4 | — | — | |
| +S4STTarget Model=DN121-CXR, Surrogate Model=DN121-IN2024.10 | 0.38 | — | — | |
| +S4STTarget Model=RN50-IN, Surrogate Model=DN121-IN2024.10 | 0.36 | — | — |