Image Classification on iWildCam WILDS (test)
46.4Macro F1WiSE-FT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| WiSE-FTalpha=optimal, fine-tuning strategy=end-to-end2021.09 | 46.4 | — | — | |
| WiSE-FTalpha=0.5, fine-tuning strategy=end-to-end2021.09 | 46.1 | — | — | |
| CLIPmode=fine-tuned, fine-tuning strategy=end-to-end2021.09 | 39.9 | — | — | |
| Meta-Distillation of MoE (Ours w/o mask)in-distribution masking=false2022.10 | 35.1 | 74.1 | — | |
| Meta-Distillation of MoE (Ours)in-distribution masking=true2022.10 | 34 | 77.2 | — | |
| CORAL2022.10 | 32.8 | 73.3 | — | |
| ERM2022.10 | 31 | 71.6 | — | |
| ARM-CMLvariant=CML2022.10 | 28.6 | 70.5 | — | |
| ARM-LLvariant=LL2022.10 | 27.4 | 71.4 | — | |
| Group DRO2022.10 | 23.9 | 72.7 | — | |
| ARM-BNvariant=BN2022.10 | 23.7 | 70.3 | — | |
| CLIPmode=zero-shot2021.09 | 15.5 | — | — | |
| IRM2022.10 | 15.1 | 59.8 | — | |
| ERMbackbone=ResNet-50, source=WILDS reported2021.04 | 0.278 | 0.629 | — | |
| Coralbackbone=ResNet-502021.04 | 0.263 | 0.625 | — | |
| ERMbackbone=ResNet-50, implementation=reproduced2021.04 | 0.251 | 0.63 | 0.624 | |
| Fishbackbone=ResNet-502021.04 | 0.242 | 0.632 | 0.64 |