Classification on Camelyon17
96.5AccuracyDINOv2
Evaluation Results
| Method | Links | |
|---|---|---|
| DINOv2Architecture=ViT-g/14, Pre-training Data=LVD, Resolution=518x518, Evaluation Protocol=Attentive Probing, Backbone State=Frozen2024.01 | 96.5 | |
| iBOTArchitecture=ViT-L/16, Pre-training Data=IN-21k, Evaluation Protocol=Attentive Probing, Backbone State=Frozen2024.01 | 94.5 | |
| AIM-1BArchitecture=ViT-1B/14, Pre-training Data=DFN-2B+, Evaluation Protocol=Attentive Probing, Backbone State=Frozen2024.01 | 94.5 | |
| MAEArchitecture=ViT-2B/14, Pre-training Data=IG-3B, Evaluation Protocol=Attentive Probing, Backbone State=Frozen2024.01 | 94.4 | |
| AIM-0.6BArchitecture=ViT-H/14, Pre-training Data=DFN-2B+, Evaluation Protocol=Attentive Probing, Backbone State=Frozen2024.01 | 94.3 | |
| AIM-3BArchitecture=ViT-3B/14, Pre-training Data=DFN-2B+, Evaluation Protocol=Attentive Probing, Backbone State=Frozen2024.01 | 94.3 | |
| MAEArchitecture=ViT-H/14, Pre-training Data=IN-1k, Evaluation Protocol=Attentive Probing, Backbone State=Frozen2024.01 | 94.2 | |
| AIM-7B†Architecture=ViT-7B/14, Pre-training Data=DFN-2B+, Feature Extraction Layer=20th, Evaluation Protocol=Attentive Probing, Backbone State=Frozen2024.01 | 94.2 | |
| DINOArchitecture=ViT-B/8, Pre-training Data=IN-1k, Evaluation Protocol=Attentive Probing, Backbone State=Frozen2024.01 | 93.7 | |
| AIM-7BArchitecture=ViT-7B/14, Pre-training Data=DFN-2B+, Evaluation Protocol=Attentive Probing, Backbone State=Frozen2024.01 | 93.6 | |
| AIMv2architecture=ViT-3B/14, Resolution=448px2024.11 | 93.4 | |
| BEiTArchitecture=ViT-L/14, Pre-training Data=IN-21k, Evaluation Protocol=Attentive Probing, Backbone State=Frozen2024.01 | 92.8 | |
| HCD + VRex*INIT.=HCD, METHOD=VRex*, Backbone=DenseNet-1212026.03 | 86.62 | |
| HCD + GroupDROINIT.=HCD, METHOD=GroupDRO, Backbone=DenseNet-1212026.03 | 86.16 | |
| HCD + IRMXINIT.=HCD, METHOD=IRMX, Backbone=DenseNet-1212026.03 | 85.91 | |
| HCD + IRMINIT.=HCD, METHOD=IRM, Backbone=DenseNet-1212026.03 | 84.31 | |
| LISAGroup labels in train set=Yes2022.09 | 77.1 | |
| LISAGroup labels in train set?=Yes2022.09 | 77.1 | |
| LISAGroup labels in train set?=Yes2022.09 | 77.1 | |
| Bonsai + VRexINIT.=Bonsai, METHOD=VRex, Backbone=DenseNet-1212026.03 | 76.39 | |
| ERM + GroupDROINIT.=ERM, METHOD=GroupDRO, Backbone=DenseNet-1212026.03 | 76.09 | |
| ERM + IRMINIT.=ERM, METHOD=IRM, Backbone=DenseNet-1212026.03 | 75.68 | |
| UMIXGroup labels in train set=No2022.09 | 75.1 | |
| UMIXGroup labels in train set?=No2022.09 | 75.1 | |
| UMIXGroup labels in train set?=No2022.09 | 75.1 | |
| FishGroup labels in train set=Yes2022.09 | 74.7 | |
| FishGroup labels in train set?=Yes2022.09 | 74.7 | |
| FishGroup labels in train set?=Yes2022.09 | 74.7 | |
| Bonsai + IRMINIT.=Bonsai, METHOD=IRM, Backbone=DenseNet-1212026.03 | 73.59 | |
| ERM + IRMXINIT.=ERM, METHOD=IRMX, Backbone=DenseNet-1212026.03 | 73.49 | |
| Bonsai + GroupDROINIT.=Bonsai, METHOD=GroupDRO, Backbone=DenseNet-1212026.03 | 72.82 | |
| ERM + VRexINIT.=ERM, METHOD=VRex, Backbone=DenseNet-1212026.03 | 71.6 | |
| V-RExGroup labels in train set=Yes2022.09 | 71.5 | |
| V-RExGroup labels in train set?=Yes2022.09 | 71.5 | |
| V-REXGroup labels in train set?=Yes2022.09 | 71.5 | |
| CVaR-DROSetting=group-oblivious2022.09 | 70.5 | |
| ERMSetting=group-oblivious2022.09 | 70.3 | |
| DomainMixGroup labels in train set=Yes2022.09 | 69.7 | |
| DomainMixGroup labels in train set?=Yes2022.09 | 69.7 | |
| DomainMixGroup labels in train set?=Yes2022.09 | 69.7 | |
| JTTSetting=group-oblivious2022.09 | 69.1 | |
| IB-IRMGroup labels in train set=Yes2022.09 | 68.9 | |
| IB-IRMGroup labels in train set?=Yes2022.09 | 68.9 | |
| IB-IRMGroup labels in train set?=Yes2022.09 | 68.9 | |
| GroupDROGroup labels in train set=Yes2022.09 | 68.4 | |
| GroupDROGroup labels in train set?=Yes2022.09 | 68.4 | |
| GroupDROGroup labels in train set?=Yes2022.09 | 68.4 | |
| Focal LossSetting=group-oblivious2022.09 | 68.1 | |
| x2-DROSetting=group-oblivious2022.09 | 68 | |
| x2-DOROSetting=group-oblivious2022.09 | 68 | |
| CVaR-DOROSetting=group-oblivious2022.09 | 67.3 | |
| Bonsai + IRMXINIT.=Bonsai, METHOD=IRMX, Backbone=DenseNet-1212026.03 | 64.77 | |
| IRMGroup labels in train set=Yes2022.09 | 64.2 | |
| IRMGroup labels in train set?=Yes2022.09 | 64.2 | |
| IRMGroup labels in train set?=Yes2022.09 | 64.2 | |
| CORALGroup labels in train set=Yes2022.09 | 59.5 | |
| CORALGroup labels in train set?=Yes2022.09 | 59.5 | |
| CORALGroup labels in train set?=Yes2022.09 | 59.5 |