Wildlife Species Classification on WILDS-iWildCam ID (test)
59.9Macro F1FLYP
Evaluation results
| Method | Links | |
|---|---|---|
| FLYPArchitecture=ViTL-336px2022.12 | 59.9 | |
| Model SoupsArchitecture=ViTL2022.12 | 57.6 | |
| ERMArchitecture=ViTL2022.12 | 55.8 | |
| ERMArchitecture=PNASNet2022.12 | 52.8 | |
| FGDRO-KLBackbone=ResNet50, Communication interval (I)=32, Local mini-batch size=32, Iterations=20K2024.10 | 52.01 | |
| FixMatchSource=Our re-run2022.11 | 51.1 | |
| FGDRO-CVaRBackbone=ResNet50, Communication interval (I)=32, Local mini-batch size=32, Iterations=20K2024.10 | 50.8 | |
| OkapiVariant=Ours2022.11 | 50.6 | |
| FedAvgBackbone=ResNet50, Communication interval (I)=32, Local mini-batch size=32, Iterations=20K2024.10 | 49.64 | |
| ERMSource=Our re-run2022.11 | 48.6 | |
| ABSGDArchitecture=ResNet502022.12 | 47.5 | |
| ERMSource=WILDS benchmark [63]2022.11 | 47 | |
| FixMatchSource=WILDS benchmark [63]2022.11 | 46.3 | |
| SCAFFOLDBackbone=ResNet50, Communication interval (I)=32, Local mini-batch size=32, Iterations=20K2024.10 | 45.27 | |
| FGDRO-KL-AdamBackbone=ResNet50, Communication interval (I)=32, Local mini-batch size=32, Iterations=20K2024.10 | 44.89 | |
| DRFABackbone=ResNet50, Communication interval (I)=32, Local mini-batch size=32, Iterations=20K2024.10 | 42 | |
| FedProxBackbone=ResNet50, Communication interval (I)=32, Local mini-batch size=32, Iterations=20K2024.10 | 39.25 | |
| FedAdamBackbone=ResNet50, Communication interval (I)=32, Local mini-batch size=32, Iterations=20K2024.10 | 35.7 | |
| DR-DSGDBackbone=ResNet50, Communication interval (I)=32, Local mini-batch size=32, Iterations=20K2024.10 | 31.57 | |
| WiSE-FTalpha=0.5, fine-tuning strategy=end-to-end2021.09 | 0.558 | |
| WiSE-FTalpha=optimal, fine-tuning strategy=end-to-end2021.09 | 0.558 | |
| CLIPmode=fine-tuned, fine-tuning strategy=end-to-end2021.09 | 0.521 | |
| CLIPmode=zero-shot2021.09 | 0.151 |