Domain Adaptation on CMNIST v1 (test)
100Accuracy (Shift 1.0)ERM+PL (all)
Evaluation Results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ERM+PL (all)Algorithm=ERM, Adaptation=PL, Updated layers=all2023.07 | 100 | 90 | 80.2 | 70.1 | 59.9 | 50.1 | 40 | 30.1 | 19.6 | 9.9 | 0 | |
| SFBAlgorithm=SFB2023.07 | 100 | 90.5 | 79.8 | 71 | 70.9 | 69.2 | 68.4 | 71.2 | 79.3 | 88.7 | 98.9 | |
| IRM+PL (all)Algorithm=IRM, Adaptation=PL, Updated layers=all2023.07 | 99.6 | 89.4 | 79.5 | 68.7 | 63.3 | 63.5 | 63.8 | 67.5 | 76.4 | 87.2 | 98.2 | |
| ERM+T3AAlgorithm=ERM, Adaptation=T3A2023.07 | 98.1 | 88.9 | 79.8 | 70.4 | 61 | 51.7 | 42.3 | 33 | 23.1 | 13.8 | 4.5 | |
| ERM+PL (last)Algorithm=ERM, Adaptation=PL, Updated layers=last2023.07 | 97.6 | 88.6 | 79.7 | 70.6 | 61.4 | 52.5 | 43.4 | 34.6 | 25 | 16.2 | 7.4 | |
| ERMAlgorithm=ERM2023.07 | 97.5 | 88.5 | 79.7 | 70.6 | 61.4 | 52.5 | 43.5 | 34.7 | 25.1 | 16.4 | 7.6 | |
| IRM+T3AAlgorithm=IRM, Adaptation=T3A2023.07 | 72.3 | 71.2 | 70.7 | 70.2 | 69.8 | 69.9 | 70.3 | 70.6 | 71.6 | 72.4 | 73.4 | |
| IRM+PL (last)Algorithm=IRM, Adaptation=PL, Updated layers=last2023.07 | 70.8 | 70.5 | 70.5 | 70.2 | 69.9 | 69.9 | 70 | 69.7 | 69.9 | 69.8 | 69.7 | |
| IRMAlgorithm=IRM2023.07 | 70.6 | 70.3 | 70.4 | 70.2 | 69.9 | 69.9 | 70.1 | 69.7 | 69.8 | 69.6 | 69.4 |