Multi-label Classification on ChestX-Ray14 (test)
84.7AUROC (%)NSGANetV1-A3
Evaluation results
| Method | Links | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NSGANetV1-A3Type=EA, #Params=5.0M, Setup=standard transfer learning setup2019.12 | 84.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NSGANetV1-XType=EA, #Params=2.2M2019.12 | 84.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CheXNet (2017)Type=manual, #Params=7.0M2019.12 | 84.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LEAF (2019)Type=EA2019.12 | 84.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| G2DData fraction=100%, Evaluation protocol=fine-tuning2023.12 | 83.1 | 79.9 | 90.2 | 75.6 | 86.9 | 84.5 | 92 | 83.1 | 96.5 | 71.8 | 84.2 | 78 | 78.2 | 74.2 | 87.7 | — | — | — | |
| S2MTS2Label Percentage=100%2021.03 | 82.51 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| KADData fraction=100%, Evaluation protocol=fine-tuning, utilize extra annotated data during pre-training=true2023.12 | 82.5 | 78.5 | 89.7 | 75.3 | 86 | 84 | 91.6 | 82.9 | 96.1 | 71.3 | 83.6 | 77.1 | 77.8 | 74 | 87.4 | — | — | — | |
| ACPLMethod Type=Pseudo labelling, Backbone=DenseNet-121, Label Percentage=20%2021.11 | 81.77 | 79.53 | 89.03 | 75.5 | 84.95 | 83.56 | 93.36 | 81.86 | 85.89 | 71.4 | 82.49 | 77.73 | 77.6 | 73.86 | 86.95 | — | — | — | |
| SRC-MTLabel Percentage=100%, Backbone=DenseNet1692021.03 | 81.75 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MorphHR10-crops=true2021.01 | 81.56 | 77.62 | 86.53 | 77.6 | 85.44 | 82.97 | 89.78 | 81.36 | 88.22 | 72.42 | 83.77 | 77.07 | 80 | 72.11 | 87.01 | — | — | — | |
| MOCO V2Label Percentage=100%2021.03 | 81.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CARZeroEvaluation Protocol=Zero-shot2024.02 | 81.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CARZeroEvaluation Protocol=zero-shot2024.02 | 81.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| G2DData fraction=10%, Evaluation protocol=fine-tuning2023.12 | 81.1 | 78.4 | 89.3 | 75.3 | 84 | 83.7 | 90.4 | 80.8 | 95.4 | 72.2 | 78.8 | 72.3 | 72.5 | 74.1 | 87.8 | — | — | — | |
| S2MTS2Label Percentage=20%2021.03 | 81.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| S2MTS2Method Type=Consistency based, Backbone=DenseNet-121, Label Percentage=20%2021.11 | 81.06 | 78.57 | 88.08 | 75.47 | 84.83 | 82.87 | 91.88 | 81.73 | 85.98 | 70.68 | 82.57 | 76.6 | 76.86 | 72.25 | 86.55 | — | — | — | |
| ConVIRTData fraction=100%, Evaluation protocol=fine-tuning2023.12 | 80.8 | 77.1 | 86.7 | 74.7 | 85.4 | 82.5 | 90.1 | 80.9 | 90.9 | 70.3 | 81.8 | 76.1 | 77.1 | 72.2 | 85.7 | — | — | — | |
| KADData fraction=10%, Evaluation protocol=fine-tuning, utilize extra annotated data during pre-training=true2023.12 | 80.7 | 77.6 | 88.9 | 75 | 83.3 | 83.3 | 90.3 | 80.7 | 95.3 | 71.8 | 78.3 | 71.9 | 72.3 | 73.7 | 87.2 | — | — | — | |
| ImageNet InitData fraction=100%, Evaluation protocol=fine-tuning2023.12 | 80.4 | 76.3 | 86.7 | 73.7 | 84.2 | 82.3 | 89.3 | 81.9 | 89.9 | 69.3 | 82.3 | 76.3 | 77 | 71.9 | 84 | — | — | — | |
| S2MTS2Label Percentage=15%2021.03 | 80.31 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MorphHR2021.01 | 80.29 | 76.12 | 85.81 | 77.38 | 84.77 | 81.5 | 88.98 | 80.59 | 85.42 | 71.13 | 82.53 | 75.15 | 78.44 | 69.7 | 86.52 | — | — | — | |
| MOCO V2Label Percentage=20%2021.03 | 80.17 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MedKLIPData fraction=100%, Evaluation protocol=fine-tuning, utilize extra annotated data during pre-training=true2023.12 | 80.1 | 76.4 | 84.9 | 75.1 | 84.8 | 82.3 | 87.9 | 81.7 | 89.2 | 69.7 | 82 | 74.7 | 77.7 | 71.2 | 83.9 | — | — | — | |
| GLoRIAData fraction=100%, Evaluation protocol=fine-tuning2023.12 | 80 | 76 | 85.5 | 73.9 | 83.2 | 81.8 | 88.7 | 81.3 | 92.1 | 70 | 81.4 | 74.9 | 76.7 | 71.5 | 82.8 | — | — | — | |
| BioViLData fraction=100%, Evaluation protocol=fine-tuning2023.12 | 80 | 76.5 | 87.1 | 74.2 | 84.2 | 82.4 | 87.1 | 82.1 | 88.8 | 69.7 | 81.9 | 75.2 | 75.9 | 71 | 84.5 | — | — | — | |
| UPSMethod Type=Pseudo labelling, Backbone=DenseNet-121, Label Percentage=20%2021.11 | 79.92 | 77.09 | 85.73 | 74.35 | 83.56 | 81.35 | 91 | 80.87 | 85.62 | 70.82 | 81.82 | 76.34 | 75.55 | 70.96 | 85.86 | — | — | — | |
| S2MTS2Label Percentage=10%2021.03 | 79.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Yao et al. (2017)Type=manual2019.12 | 79.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Google AutoML (2018)Type=RL2019.12 | 79.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NoTeacherLabel Percentage=20%2021.03 | 79.49 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MRMEvaluation Protocol=1% fine-tuned2024.02 | 79.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MOCO V2Label Percentage=15%2021.03 | 79.37 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SRC-MTLabel Percentage=20%, Backbone=DenseNet1692021.03 | 79.23 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SRC-MTMethod Type=Consistency based, Backbone=DenseNet-169, Label Percentage=20%2021.11 | 79.23 | 75.38 | 87.7 | 73.11 | 82.94 | 81.58 | 88.98 | 79.22 | 87.27 | 70.4 | 78.03 | 73.64 | 75.63 | 69.27 | 86.12 | — | — | — | |
| G2DData fraction=1%, Evaluation protocol=fine-tuning2023.12 | 79.1 | 78.1 | 88.3 | 72.9 | 81.6 | 83.1 | 90.2 | 74.4 | 94.1 | 70.2 | 75.4 | 69.7 | 69.5 | 74 | 86.5 | — | — | — | |
| Random InitData fraction=100%, Evaluation protocol=fine-tuning2023.12 | 79 | 75 | 87.9 | 73.1 | 83.9 | 81.5 | 83.5 | 80.7 | 90.3 | 69.1 | 79.8 | 72.6 | 75.4 | 70.3 | 82.6 | — | — | — | |
| S2MTS2Label Percentage=5%2021.03 | 78.96 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| KADEvaluation Protocol=Zero-shot2024.02 | 78.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GraphXNet [44]2021.01 | 78.88 | 71.89 | 87.99 | 73.36 | 80.2 | 79.2 | 84.07 | 80.34 | 87.22 | 72.05 | 80.9 | 71.13 | 75.7 | 76.64 | 83.7 | — | — | — | |
| MTMethod Type=Consistency based, Backbone=DenseNet-169, Label Percentage=20%2021.11 | 78.83 | 75.12 | 87.37 | 72.51 | 82.72 | 80.81 | 88.16 | 78.24 | 87.74 | 70.67 | 77.72 | 73.27 | 74.43 | 69.17 | 85.63 | — | — | — | |
| KADEvaluation Protocol=1% fine-tuned2024.02 | 78.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| KADData fraction=1%, Evaluation protocol=fine-tuning, utilize extra annotated data during pre-training=true2023.12 | 78.7 | 77 | 88.2 | 72.7 | 81.3 | 82.9 | 89.3 | 74.3 | 93.8 | 69.2 | 75.1 | 69.7 | 69.2 | 73.5 | 86.1 | — | — | — | |
| MGCAEvaluation Protocol=1% fine-tuned2024.02 | 78.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Densenet-121Method Type=Supervised, Backbone=DenseNet-121, Label Percentage=20%2021.11 | 78.19 | 75.75 | 80.71 | 71.85 | 81.61 | 79.87 | 89.75 | 79.3 | 86.05 | 69.16 | 78.4 | 74.49 | 73.46 | 69.55 | 84.7 | — | — | — | |
| Graph XNetLabel Percentage=20%, Backbone=DenseNet1692021.03 | 78 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GraphXNetMethod Type=Pseudo labelling, Backbone=DenseNet-121, Label Percentage=20%2021.11 | 78 | 71.89 | 87.99 | 73.36 | 80.2 | 79.2 | 84.07 | 80.34 | 87.22 | 72.05 | 80.9 | 71.13 | 75.7 | 76.64 | 83.7 | — | — | — | |
| SRC-MTLabel Percentage=15%, Backbone=DenseNet1692021.03 | 77.76 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NoTeacherLabel Percentage=10%2021.03 | 77.61 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MedKLIPEvaluation Protocol=1% fine-tuned2024.02 | 77.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ConVIRTData fraction=10%, Evaluation protocol=fine-tuning2023.12 | 77.1 | 74 | 84.3 | 70.1 | 81.4 | 81.1 | 87.1 | 76.7 | 89.3 | 69.3 | 74.8 | 70 | 71.9 | 67.1 | 82.8 | — | — | — | |
| MOCO V2Label Percentage=10%2021.03 | 77.07 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NoTeacherLabel Percentage=5%2021.03 | 77.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Yao [43]2021.01 | 76.1 | 73.3 | 85.6 | 71.1 | 80.6 | 80.6 | 84.2 | 74.3 | 77.5 | 67.3 | 77.7 | 71.8 | 72.4 | 68.4 | 80.5 | — | — | — | |
| SRC-MTLabel Percentage=10%, Backbone=DenseNet1692021.03 | 75.28 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MedKLIPData fraction=10%, Evaluation protocol=fine-tuning, utilize extra annotated data during pre-training=true2023.12 | 74.8 | 72.9 | 80.2 | 69.6 | 81.1 | 79.3 | 79.5 | 75.6 | 81.9 | 69.8 | 71.9 | 68.1 | 71.3 | 66.6 | 79.6 | — | — | — | |
| FedFewEBM=true2022.06 | 74.79 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| S2MTS2Label Percentage=2%2021.03 | 74.69 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GLoRIAData fraction=10%, Evaluation protocol=fine-tuning2023.12 | 74.3 | 72.1 | 80.8 | 67.6 | 79.7 | 80 | 79.9 | 78.7 | 78.7 | 68.7 | 73.3 | 67.5 | 69.3 | 65.8 | 77.9 | — | — | — | |
| FedFewEBM=false2022.06 | 74.23 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MOCO V2Label Percentage=5%2021.03 | 73.84 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Wang et al. (2017)Type=manual2019.12 | 73.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Wang [43]2021.01 | 73.8 | 70.03 | 81 | 70.32 | 80.52 | 75.85 | 83.3 | 78.59 | 87.17 | 66.14 | 69.33 | 66.87 | 68.35 | 65.8 | 79.93 | — | — | — | |
| BioViLEvaluation Protocol=Zero-shot2024.02 | 72.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BioViLData fraction=10%, Evaluation protocol=fine-tuning2023.12 | 72.7 | 70.3 | 78.5 | 68.4 | 79.9 | 79 | 76.1 | 74.8 | 76.3 | 66.6 | 71.8 | 67.1 | 65.3 | 66.5 | 76.7 | — | — | — | |
| NoTeacherLabel Percentage=2%2021.03 | 72.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MedKLIPEvaluation Protocol=Zero-shot2024.02 | 72.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ImageNet InitData fraction=10%, Evaluation protocol=fine-tuning2023.12 | 72.6 | 70.9 | 79.8 | 67.1 | 76.7 | 76.9 | 74.9 | 72.9 | 81 | 68.4 | 69.3 | 65.6 | 71.1 | 63 | 79.3 | — | — | — | |
| SRC-MTLabel Percentage=5%, Backbone=DenseNet1692021.03 | 72.29 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MLCFSSL=true2022.06 | 72.27 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CheXzeroEvaluation Protocol=Zero-shot2024.02 | 71.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GLORIAEvaluation Protocol=1% fine-tuned2024.02 | 70.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Random InitData fraction=10%, Evaluation protocol=fine-tuning2023.12 | 69.1 | 68.2 | 76.6 | 67.8 | 78 | 74.6 | 64.7 | 71.5 | 77.1 | 67.4 | 62.3 | 58 | 65.3 | 63.6 | 72.8 | — | — | — | |
| MLCFSSL=false2022.06 | 69.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Graph XNetLabel Percentage=15%, Backbone=DenseNet1692021.03 | 68 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SRC-MTLabel Percentage=2%, Backbone=DenseNet1692021.03 | 66.95 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MOCO V2Label Percentage=2%2021.03 | 65.97 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ConVIRTData fraction=1%, Evaluation protocol=fine-tuning2023.12 | 64.9 | 66 | 78.2 | 65.7 | 60.7 | 78.9 | 65.8 | 68 | 46.6 | 61.1 | 59.6 | 65.5 | 62.7 | 60.8 | 68.8 | — | — | — | |
| BiomedCLIPEvaluation Protocol=Zero-shot2024.02 | 63.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ImageNet InitData fraction=1%, Evaluation protocol=fine-tuning2023.12 | 63.5 | 66.2 | 64.2 | 62.4 | 66.8 | 72.1 | 61.5 | 70.7 | 64.5 | 57 | 59 | 58.5 | 63.1 | 60 | 62.6 | — | — | — | |
| Graph XNetLabel Percentage=10%, Backbone=DenseNet1692021.03 | 63 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GLORIAEvaluation Protocol=Zero-shot2024.02 | 61 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MedKLIPData fraction=1%, Evaluation protocol=fine-tuning, utilize extra annotated data during pre-training=true2023.12 | 60.9 | 65.5 | 59 | 65.9 | 68.2 | 74.5 | 53.5 | 64.8 | 40 | 64.3 | 55 | 61.1 | 59.3 | 60.9 | 59.9 | — | — | — | |
| GLoRIAData fraction=1%, Evaluation protocol=fine-tuning2023.12 | 59.7 | 59.7 | 56.7 | 66.5 | 66.9 | 74.1 | 55 | 55.8 | 43.6 | 64.6 | 55.9 | 55.7 | 59.2 | 61.1 | 60.7 | — | — | — | |
| Random InitData fraction=1%, Evaluation protocol=fine-tuning2023.12 | 58.1 | 55.7 | 57.7 | 60.8 | 63.3 | 63.6 | 53.4 | 63.7 | 46 | 61.6 | 55 | 60.2 | 56.8 | 57.1 | 58.2 | — | — | — | |
| Graph XNetLabel Percentage=5%, Backbone=DenseNet1692021.03 | 58 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BioViLData fraction=1%, Evaluation protocol=fine-tuning2023.12 | 57.9 | 55.5 | 56.4 | 65.7 | 68.1 | 72.2 | 51.6 | 51.3 | 36 | 65 | 56.7 | 54.6 | 59.2 | 62.6 | 56 | — | — | — | |
| MedCLIPEvaluation Protocol=Zero-shot2024.02 | 56.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Graph XNetLabel Percentage=2%, Backbone=DenseNet1692021.03 | 53 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Aligned-MTL-UB2024.02 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | -14.14 | — | — | |
| BayesAgg-MTL2024.02 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | -14.96 | — | — | |
| CAGrad2024.02 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | -14.49 | — | — | |
| Centralizedbeta=0.5, gamma=0.52025.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 71.66 | 79.54 | |
| Centralizedbeta=0.1, gamma=0.52025.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 71.66 | 79.54 | |
| DWA2024.02 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | -14.79 | — | — | |
| FedAvgbeta=0.5, gamma=0.52025.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 69.02 | 73.18 | |
| FedAvgbeta=0.1, gamma=0.52025.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 69.05 | 77.9 | |
| FedCurvbeta=0.5, gamma=0.52025.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 68.72 | 72.15 | |
| FedCurvbeta=0.1, gamma=0.52025.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 69.34 | 77.36 | |
| FedLGTbeta=0.5, gamma=0.52025.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 69.86 | 72.27 | |
| FedLGTbeta=0.1, gamma=0.52025.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 70.16 | 77.67 |