Image Classification on Digits-Five
99.5Accuracy (Source: mt)Oracle
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| OracleSetting=UMDA2025.10 | 99.5 | 95.4 | 92.3 | 98.7 | 99.2 | 97 | — | — | — | — | — | |
| FACTSetting=UMDA2025.10 | 99.3 | 91.4 | 90.9 | 94.8 | 98.3 | 95 | — | — | — | — | — | |
| T-SVDNetStandard=Multi-Source, Training Data=All available samples2021.07 | 99.28 | 91.22 | 84.86 | 95.71 | 98.63 | 93.94 | — | — | — | — | — | |
| T-SVDNetStandard=Multi-Source, Training Data=Subset (25k samples per domain)2021.07 | 99.24 | 90.05 | 84.03 | 94.92 | 98.61 | 93.37 | — | — | — | — | — | |
| KD3ASetting=UMDA2025.10 | 99.2 | 87.3 | 85.6 | 89.4 | 98.5 | 92 | — | — | — | — | — | |
| GALASetting=UMDA2025.10 | 99.2 | 93 | 91.2 | 95.2 | 98.3 | 95.4 | — | — | — | — | — | |
| SFDASetting=UMDA2025.10 | 99.1 | 72.3 | 86 | 90.4 | 98.1 | 89.2 | — | — | — | — | — | |
| CMSSSetting=UMDA2025.10 | 99 | 75.3 | 88.4 | 93.7 | 97.7 | 90.8 | — | — | — | — | — | |
| MDDAStandard=Multi-Source2021.07 | 98.78 | 78.63 | 79.33 | 89.71 | 93.91 | 88.12 | — | — | — | — | — | |
| SubFLOT2026.04 | 98.65 | 88.81 | 84.98 | 92.27 | 98.2 | 92.58 | — | — | — | — | — | |
| M3SDAStandard=Multi-Source2021.07 | 98.43 | 72.82 | 81.32 | 89.58 | 96.14 | 87.65 | — | — | — | — | — | |
| M3SDASetting=UMDA2025.10 | 98.4 | 72.8 | 81.3 | 89.6 | 96.2 | 87.7 | — | — | — | — | — | |
| SHOTSetting=UMDA2025.10 | 98.2 | 80.2 | 84.5 | 91.1 | 97.1 | 90.2 | — | — | — | — | — | |
| MDANStandard=Multi-Source2021.07 | 98.04 | 69.48 | 69.23 | 87.44 | 92.39 | 83.3 | — | — | — | — | — | |
| DANNStandard=Source Combination2021.07 | 97.91 | 70.8 | 68.54 | 87.4 | 93.53 | 83.61 | — | — | — | — | — | |
| ADDAStandard=Single Best2021.07 | 97.89 | 71.57 | 75.48 | 86.45 | 92.83 | 84.84 | — | — | — | — | — | |
| ADDAStandard=Source Combination2021.07 | 97.88 | 72.32 | 75.02 | 86.69 | 93.1 | 85.02 | — | — | — | — | — | |
| ATP-batchinference mode=batch2023.10 | 97.81 | 69.98 | 62.18 | 87.91 | 95.41 | — | — | — | — | — | — | |
| ATP-onlineinference mode=online2023.10 | 97.81 | 70.78 | 62.64 | 88.33 | 95.56 | — | — | — | — | — | — | |
| DANNStandard=Single Best2021.07 | 97.6 | 71.3 | 63.48 | 85.34 | 92.33 | 82.01 | — | — | — | — | — | |
| DANStandard=Source Combination2021.07 | 97.52 | 67.91 | 67.79 | 86.9 | 93.45 | 82.69 | — | — | — | — | — | |
| Surgical2023.10 | 97.35 | 65.87 | 59.93 | 86.06 | 94.19 | — | — | — | — | — | — | |
| CORALStandard=Single Best2021.07 | 97.21 | 62.53 | 64.4 | 82.77 | 93.45 | 80.07 | — | — | — | — | — | |
| JANStandard=Source Combination2021.07 | 97.21 | 65.88 | 75.27 | 86.55 | 95.42 | 84.07 | — | — | — | — | — | |
| Source-OnlyStandard=Single Best2021.07 | 97.2 | 52.9 | 77.7 | 85.2 | 84.7 | 80.8 | — | — | — | — | — | |
| MDANSetting=UMDA2025.10 | 97.2 | 75.7 | 82.2 | 85.2 | 93.3 | 86.7 | — | — | — | — | — | |
| DSBNSetting=UMDA2025.10 | 97.2 | 71.6 | 77.9 | 88.7 | 96.1 | 86.3 | — | — | — | — | — | |
| EM2023.10 | 96.64 | 62.08 | 57.21 | 85.69 | 92.29 | — | — | — | — | — | — | |
| DANStandard=Single Best2021.07 | 96.31 | 63.78 | 62.45 | 85.43 | 94.24 | 80.44 | — | — | — | — | — | |
| DCTNStandard=Multi-Source2021.07 | 96.23 | 70.53 | 77.61 | 86.77 | 92.81 | 84.79 | — | — | — | — | — | |
| MCDStandard=Source Combination2021.07 | 96.21 | 72.5 | 78.89 | 87.47 | 95.33 | 86.1 | — | — | — | — | — | |
| MEMO2023.10 | 95.92 | 55.48 | 52.85 | 80.12 | 89.84 | — | — | — | — | — | — | |
| Tent2023.10 | 95.48 | 62.49 | 60.67 | 78.56 | 91.65 | — | — | — | — | — | — | |
| No adaptationadaptation=none2023.10 | 95.47 | 55.62 | 52.28 | 79.75 | 89.62 | — | — | — | — | — | — | |
| FlexFL2026.04 | 95.23 | 69.45 | 62.34 | 74.12 | 95.1 | 79.25 | — | — | — | — | — | |
| DepthFL2026.04 | 95.01 | 69.87 | 61.23 | 73.12 | 94.9 | 78.83 | — | — | — | — | — | |
| BN-Adapt2023.10 | 94.9 | 59.68 | 57.57 | 75.34 | 89.51 | — | — | — | — | — | — | |
| AdaptiveFL2026.04 | 94.9 | 68.34 | 60.12 | 73.23 | 94.87 | 78.29 | — | — | — | — | — | |
| Flado2026.04 | 94.89 | 68.56 | 60.45 | 72.34 | 94.78 | 78.2 | — | — | — | — | — | |
| FedDSE2026.04 | 94.76 | 67.9 | 59.34 | 72.89 | 94.67 | 77.91 | — | — | — | — | — | |
| SHOT2023.10 | 94.69 | 60.19 | 57.91 | 76.43 | 89.55 | — | — | — | — | — | — | |
| HeteroFL2026.04 | 94.68 | 67.44 | 59.6 | 71.73 | 94.49 | 77.59 | — | — | — | — | — | |
| T3A2023.10 | 94.63 | 51.25 | 49.9 | 75.47 | 88.46 | — | — | — | — | — | — | |
| BBSE2023.10 | 94.47 | 61.59 | 57.26 | 85.54 | 91.34 | — | — | — | — | — | — | |
| FedRolex2026.04 | 94.3 | 66.07 | 52.7 | 70.6 | 94.2 | 75.57 | — | — | — | — | — | |
| FedMP2026.04 | 93.86 | 64.69 | 54.91 | 67.97 | 93.32 | 74.95 | — | — | — | — | — | |
| ScaleFL2026.04 | 92.72 | 65.23 | 55.89 | 68.45 | 93.01 | 75.06 | — | — | — | — | — | |
| Source-onlySetting=UMDA2025.10 | 92.3 | 63.7 | 71.5 | 83.4 | 90.71 | 80.3 | — | — | — | — | — | |
| FADASetting=UMDA2025.10 | 91.4 | 62.5 | 50.5 | 71.8 | 91.7 | 73.6 | — | — | — | — | — | |
| Source-OnlyStandard=Source Combination2021.07 | 90.5 | 63.37 | 63.54 | 82.44 | 88.71 | 77.71 | — | — | — | — | — | |
| Upper-bound: Superv. (targets)training_setting=targets supervision2020.07 | 88.1 | 90.2 | 93 | 90.3 | 89.1 | 90.1 | — | — | — | — | — | |
| FedDrop2026.04 | 84.14 | 50.14 | 40.45 | 53.48 | 83.75 | 62.39 | — | — | — | — | — | |
| AMEANS2020.07 | 61.2 | 66.9 | 67.2 | 73.3 | 47.5 | 63.2 | — | — | — | — | — | |
| RevGrad2020.07 | 60.2 | 66 | 64.7 | 69.2 | 44.3 | 60.9 | — | — | — | — | — | |
| MT-MTDA Mixeddomain_labels=false2020.07 | 59.5 | 71.5 | 69.9 | 78.3 | 49.6 | 65.8 | — | — | — | — | — | |
| MT-MTDAdomain_labels=true2020.07 | 58.6 | 71 | 67.6 | 75.6 | 51 | 64.7 | — | — | — | — | — | |
| AMEANSBackbone=AlexNet2020.07 | 56.2 | 65.2 | 67.3 | 71.3 | 47.5 | 61.5 | — | — | — | — | — | |
| MT-MTDABackbone=AlexNet2020.07 | 54.3 | 73.4 | 67.1 | 73.1 | 64 | 66.4 | — | — | — | — | — | |
| ADDA2020.07 | 52.5 | 58.9 | 46.4 | 67 | 34.8 | 51.9 | — | — | — | — | — | |
| RevGradBackbone=AlexNet2020.07 | 52.4 | 64 | 65.3 | 66.6 | 44.3 | 58.5 | — | — | — | — | — | |
| MT-MTDA MixedBackbone=AlexNet2020.07 | 51.6 | 69.2 | 79.7 | 76 | 61.5 | 67.6 | — | — | — | — | — | |
| ADDABackbone=AlexNet2020.07 | 43.7 | 55.9 | 40.4 | 66.1 | 34.8 | 48.2 | — | — | — | — | — | |
| DADA2020.07 | 39.4 | 61.1 | 80.1 | 83.7 | 47.2 | 62.3 | — | — | — | — | — | |
| DAN2020.07 | 38.8 | 53.5 | 55.1 | 65.8 | 27 | 48 | — | — | — | — | — | |
| Lower-bound: Superv. (source only)training_setting=source only supervision2020.07 | 36.6 | 57.3 | 67.1 | 74.9 | 36.9 | 54.6 | — | — | — | — | — | |
| DANBackbone=AlexNet2020.07 | 31.3 | 53.1 | 48.7 | 63.3 | 27 | 44.7 | — | — | — | — | — | |
| Source onlyBackbone=AlexNet2020.07 | 26.9 | 56 | 67.2 | 73.8 | 36.9 | 52.2 | — | — | — | — | — | |
| ADDASetting=Target Combined2021.04 | — | — | — | — | — | 48.2 | 43.7 | 55.9 | 40.4 | 66.1 | 34.8 | |
| AMEANSetting=Target Combined2021.04 | — | — | — | — | — | 61.5 | 56.2 | 65.2 | 67.3 | 71.3 | 47.5 | |
| CDANSetting=Target Combined2021.04 | — | — | — | — | — | 66.5 | 53 | 76.3 | 65.6 | 81.5 | 56.2 | |
| CDANSetting=Multi-Target2021.04 | — | — | — | — | — | 64.2 | 53.7 | 76.2 | 64.4 | 80.3 | 46.2 | |
| CDAN + DCLSetting=Multi-Target2021.04 | — | — | — | — | — | 78.6 | 62 | 87.8 | 87.8 | 92.3 | 63.2 | |
| CGCTSetting=Target Combined2021.04 | — | — | — | — | — | 72.8 | 54.3 | 85.5 | 83.8 | 87.8 | 52.4 | |
| D-CGCTSetting=Multi-Target2021.04 | — | — | — | — | — | 79.9 | 65.7 | 89 | 88.9 | 93.2 | 62.9 | |
| DANSetting=Target Combined2021.04 | — | — | — | — | — | 44.7 | 31.3 | 53.1 | 48.7 | 63.3 | 27 | |
| GTASetting=Target Combined2021.04 | — | — | — | — | — | 55 | 44.6 | 54.5 | 60.3 | 74.5 | 41.3 | |
| RevGradSetting=Target Combined2021.04 | — | — | — | — | — | 58.5 | 52.4 | 64 | 65.3 | 66.6 | 44.3 | |
| Source onlySetting=Target Combined2021.04 | — | — | — | — | — | 52.2 | 26.9 | 56 | 67.2 | 73.8 | 36.9 |