Open-set Test-Time Adaptation on LAION-C (severity = 3, kappa = 0.5)
28.1Places-L ACCDOCO
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| DOCOseverity=3, kappa=0.5, setting=OCTTA, switching domains=62026.04 | 28.1 | 62.2 | 24.4 | 64.8 | 25.7 | 78.2 | 23.2 | 71.2 | 26.1 | 53.7 | 24.6 | 59.2 | 25.4 | 64.9 | 32.7 | |
| UniEntseverity=3, kappa=0.5, setting=OCTTA, switching domains=62026.04 | 24 | 58.3 | 23.8 | 64.5 | 23.7 | 66 | 23.6 | 64.5 | 24.4 | 54.4 | 23.1 | 57 | 23.8 | 60.8 | 29.3 | |
| EATAseverity=3, kappa=0.5, setting=OCTTA, switching domains=62026.04 | 23.9 | 56 | 23.3 | 59.9 | 20.7 | 59.6 | 22.5 | 60.3 | 25 | 54.4 | 23.1 | 55.1 | 23.1 | 57.5 | 27.9 | |
| DPCoreseverity=3, kappa=0.5, setting=OCTTA, switching domains=62026.04 | 23.4 | 61.6 | 21.1 | 63.3 | 20.6 | 65.5 | 25 | 64.2 | 24.8 | 55.6 | 23.9 | 59.8 | 23.1 | 61.7 | 30.3 | |
| STAMPseverity=3, kappa=0.5, setting=OCTTA, switching domains=62026.04 | 16.4 | 53.5 | 15.6 | 54.1 | 15.3 | 56.5 | 16 | 53.8 | 16.2 | 55 | 15.7 | 55.9 | 15.9 | 54.8 | 19.5 | |
| OSTTAseverity=3, kappa=0.5, setting=OCTTA, switching domains=62026.04 | 16.3 | 49.4 | 16.7 | 48.6 | 15.6 | 47.6 | 14.5 | 48.6 | 17.1 | 54.4 | 16.9 | 53.7 | 16.2 | 50.4 | 17.5 | |
| Sourceseverity=3, kappa=0.5, setting=OCTTA, switching domains=62026.04 | 16.2 | 52.2 | 16.2 | 54.8 | 16.2 | 58.9 | 16.2 | 54.9 | 16.2 | 54.8 | 16.2 | 55.8 | 16.2 | 55.2 | 19.1 | |
| CoTTAseverity=3, kappa=0.5, setting=OCTTA, switching domains=62026.04 | 16.2 | 50.7 | 16.1 | 51.7 | 16.1 | 56.1 | 16.1 | 52.8 | 16.1 | 54.5 | 16.1 | 54.8 | 16.1 | 53.4 | 18.5 | |
| SARseverity=3, kappa=0.5, setting=OCTTA, switching domains=62026.04 | 7.6 | 50.6 | 9.4 | 51.8 | 4.5 | 47.9 | 4.6 | 48.4 | 13.6 | 54.4 | 5.1 | 51.5 | 7.5 | 50.8 | 9.6 | |
| E-COMEseverity=3, kappa=0.5, setting=OCTTA, switching domains=62026.04 | 4.6 | 53.1 | 17.9 | 57.6 | 16.5 | 63.6 | 18.1 | 61.4 | 18.8 | 52.3 | 17.3 | 56.4 | 15.5 | 57.4 | 19.9 | |
| ViDAseverity=3, kappa=0.5, setting=OCTTA, switching domains=62026.04 | 2.5 | 42.7 | 3.2 | 48.6 | 2.7 | 36.5 | 2 | 40.4 | 2.2 | 49 | 2.4 | 47.1 | 2.5 | 44 | 3.9 | |
| Tentseverity=3, kappa=0.5, setting=OCTTA, switching domains=62026.04 | 0.2 | 47.4 | 0.2 | 58.9 | 0.4 | 46.5 | 0.2 | 49.8 | 0.4 | 49.3 | 0.2 | 53.4 | 0.3 | 50.9 | 0.6 | |
| S-COMEseverity=3, kappa=0.5, setting=OCTTA, switching domains=62026.04 | 0.1 | 46.4 | 0.1 | 55.4 | 0.2 | 47.6 | 0.1 | 48.8 | 0.1 | 53.3 | 0.1 | 54.2 | 0.1 | 51 | 0.3 |