Multiclass Classification on iWildCam WILDS 2.0 (OOD)
46Macro F1FLYP
Evaluation Results
| Method | Links | |
|---|---|---|
| FLYPArchitecture=ViTL-336px2022.12 | 46 | |
| Model SoupsArchitecture=ViTL2022.12 | 43.3 | |
| ERMArchitecture=ViTL2022.12 | 41.4 | |
| ERMArchitecture=PNASNet2022.12 | 38.5 | |
| OkapiVariant=Ours2022.11 | 36.1 | |
| FixMatchSource=Our re-run2022.11 | 35.2 | |
| CORAL + SDGBase Algorithm=CORAL, Optimization=SDG2023.08 | 34.6 | |
| CORAL + SAND-MASKBase Algorithm=CORAL, Optimization=SAND-MASK2023.08 | 33.9 | |
| ERMSource=Our re-run2022.11 | 33.3 | |
| ABSGDArchitecture=ResNet502022.12 | 33 | |
| FISH + SDGBase Algorithm=FISH, Optimization=SDG2023.08 | 32.9 | |
| CORALBase Algorithm=CORAL, Optimization=Standard2023.08 | 32.8 | |
| ERMSource=WILDS benchmark [63]2022.11 | 32.2 | |
| FixMatchSource=WILDS benchmark [63]2022.11 | 31 | |
| ERMBase Algorithm=ERM2023.08 | 31 | |
| FISHBase Algorithm=FISH, Optimization=Standard2023.08 | 22 | |
| CORAL + AND-MASKBase Algorithm=CORAL, Optimization=AND-MASK2023.08 | 8.2 |