List your company
ResearchFormerly WizWand

Multiclass Classification on iWildCam WILDS 2.0 (OOD)

46Macro F1FLYP
6.68816.89427.137.306Nov 7, 2022Dec 26, 2022Feb 13, 2023Apr 4, 2023May 23, 2023Jul 11, 2023Aug 30, 2023
Updated 8mo ago

Evaluation results

MethodLinks
FLYPArchitecture=ViTL-336px2022.1246
Model SoupsArchitecture=ViTL2022.1243.3
ERMArchitecture=ViTL2022.1241.4
ERMArchitecture=PNASNet2022.1238.5
OkapiVariant=Ours2022.1136.1
FixMatchSource=Our re-run2022.1135.2
CORAL + SDGBase Algorithm=CORAL, Optimization=SDG2023.0834.6
CORAL + SAND-MASKBase Algorithm=CORAL, Optimization=SAND-MASK2023.0833.9
ERMSource=Our re-run2022.1133.3
ABSGDArchitecture=ResNet502022.1233
FISH + SDGBase Algorithm=FISH, Optimization=SDG2023.0832.9
CORALBase Algorithm=CORAL, Optimization=Standard2023.0832.8
ERMSource=WILDS benchmark [63]2022.1132.2
FixMatchSource=WILDS benchmark [63]2022.1131
ERMBase Algorithm=ERM2023.0831
FISHBase Algorithm=FISH, Optimization=Standard2023.0822
CORAL + AND-MASKBase Algorithm=CORAL, Optimization=AND-MASK2023.088.2