Domain Adaptation on PACS (test)
89Accuracy (Ph -> Ar, Clean)DANN
Evaluation Results
| Method | Links | ||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| DANNBackbone=CLIP ViT-B/32, Attack Type=PGD, Attack Steps=20, Epsilon (ϵ)=2/2552026.07 | 89 | 5.5 | 80.5 | 11.5 | 74.2 | 24 | 84.8 | 0.5 | 92.3 | 1 | 78 | 25.8 | 84.2 | 12.5 | 97.9 | 2.7 | 84.9 | 0.5 | 68 | 45 | 72.1 | 14.2 | 71.3 | 0.1 | 81.4 | 11.9 | |
| DANNBackbone=ViT-B/32, Attack Type=PGD, Attack Steps=20, Epsilon (ϵ)=2/2552026.07 | 89 | 5.5 | 80.5 | 11.5 | 74.2 | 24 | 84.8 | 0.5 | 92.3 | 1 | 78 | 25.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SFT+RLBackbone=CLIP ViT-B/32, Attack Type=PGD, Attack Steps=20, Epsilon (ϵ)=2/2552026.07 | 88.3 | 75.4 | 78.8 | 70.1 | 78.2 | 76.7 | 94.6 | 79.6 | 95.5 | 87.9 | 81.5 | 83.5 | 95.7 | 90.8 | 98.5 | 88.7 | 82.9 | 83.1 | 82.4 | 52.7 | 89.7 | 80.3 | 71.6 | 59.3 | 86.5 | 77.3 | |
| SFT+RLBackbone=ViT-B/32, Attack Type=PGD, Attack Steps=20, Epsilon (ϵ)=2/2552026.07 | 88.3 | 75.4 | 78.8 | 70.1 | 78.2 | 76.7 | 94.6 | 79.6 | 95.5 | 87.9 | 81.5 | 83.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ARTUDABackbone=CLIP ViT-B/32, Attack Type=PGD, Attack Steps=20, Epsilon (ϵ)=2/2552026.07 | 85.9 | 60.1 | 87.5 | 78.1 | 74.9 | 70.4 | 76.5 | 53.3 | 89.4 | 75 | 80.3 | 74.9 | 88.1 | 76 | 95 | 78.5 | 80.3 | 61.5 | 49.5 | 31.7 | 38.1 | 28.5 | 48.9 | 40.4 | 74.5 | 60.7 | |
| ARTUDABackbone=ViT-B/32, Attack Type=PGD, Attack Steps=20, Epsilon (ϵ)=2/2552026.07 | 85.9 | 60.1 | 87.5 | 78.1 | 74.9 | 70.4 | 76.5 | 53.3 | 89.4 | 75 | 80.3 | 74.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DARTBackbone=CLIP ViT-B/32, Attack Type=PGD, Attack Steps=20, Epsilon (ϵ)=2/2552026.07 | 85.2 | 58 | 89.4 | 80.5 | 82.5 | 79.9 | 77.4 | 54.6 | 94.2 | 79.8 | 84.9 | 80.7 | 89.1 | 79.1 | 98.15 | 81.4 | 89.5 | 86.4 | 71.9 | 53.1 | 78.4 | 69.2 | 87.8 | 76.8 | 85.7 | 73.3 | |
| DARTBackbone=ViT-B/32, Attack Type=PGD, Attack Steps=20, Epsilon (ϵ)=2/2552026.07 | 85.2 | 58 | 89.4 | 80.5 | 82.5 | 79.9 | 77.4 | 54.6 | 94.2 | 79.8 | 84.9 | 80.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| UDA+ATBackbone=CLIP ViT-B/32, Attack Type=PGD, Attack Steps=20, Epsilon (ϵ)=2/2552026.07 | 82.1 | 59 | 85.2 | 77.1 | 78 | 75.3 | 76.2 | 55 | 93.1 | 80.2 | 80.1 | 77.2 | 85 | 76.3 | 95 | 83.1 | 84.8 | 81.1 | 62.1 | 37.5 | 72.5 | 64 | 88.8 | 73.6 | 81.9 | 70 | |
| UDA+ATBackbone=ViT-B/32, Attack Type=PGD, Attack Steps=20, Epsilon (ϵ)=2/2552026.07 | 82.1 | 59 | 85.2 | 77.1 | 78 | 75.3 | 76.2 | 55 | 93.1 | 80.2 | 80.1 | 77.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| UDA + TradesBackbone=CLIP ViT-B/32, Attack Type=PGD, Attack Steps=20, Epsilon (ϵ)=2/2552026.07 | 82 | 63 | 84.2 | 76.5 | 78.6 | 75.2 | 78.5 | 58 | 92.2 | 82.1 | 79.9 | 77.6 | 85.1 | 77 | 98.3 | 82.2 | 86 | 83.3 | 69 | 44.2 | 76.6 | 63.8 | 89.6 | 76.4 | 83.3 | 71.6 | |
| UDA + TradesBackbone=ViT-B/32, Attack Type=PGD, Attack Steps=20, Epsilon (ϵ)=2/2552026.07 | 82 | 63 | 84.2 | 76.5 | 78.6 | 75.2 | 78.5 | 58 | 92.2 | 82.1 | 79.9 | 77.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| UDA + MartBackbone=CLIP ViT-B/32, Attack Type=PGD, Attack Steps=20, Epsilon (ϵ)=2/2552026.07 | 80.5 | 62.7 | 81.2 | 77.6 | 77.2 | 75.8 | 76.2 | 57.8 | 91.7 | 82.6 | 79.1 | 78.2 | 84.9 | 78.1 | 95.5 | 82.5 | 85.2 | 83.7 | 67.5 | 45.6 | 71.8 | 63.1 | 88.3 | 77.1 | 81.6 | 72.1 | |
| UDA + MartBackbone=ViT-B/32, Attack Type=PGD, Attack Steps=20, Epsilon (ϵ)=2/2552026.07 | 80.5 | 62.7 | 81.2 | 77.6 | 77.2 | 75.8 | 76.2 | 57.8 | 91.7 | 82.6 | 79.1 | 78.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SRoUDABackbone=CLIP ViT-B/32, Attack Type=PGD, Attack Steps=20, Epsilon (ϵ)=2/2552026.07 | 76.1 | 56.4 | 82.4 | 71.7 | 71.9 | 63.7 | 72 | 50.9 | 90.3 | 79.9 | 76.7 | 72.3 | 84.2 | 75.8 | 94.1 | 81.5 | 77.3 | 73.2 | 24.8 | 22.4 | 72.4 | 62.3 | 91.9 | 73.1 | 76.2 | 65.3 | |
| SRoUDABackbone=ViT-B/32, Attack Type=PGD, Attack Steps=20, Epsilon (ϵ)=2/2552026.07 | 76.1 | 56.4 | 82.4 | 71.7 | 71.9 | 63.7 | 72 | 50.9 | 90.3 | 79.9 | 76.7 | 72.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — |