Group Robustness on Amazon-WILDS (test)
87.9WG AccuracyContrast. Adapter
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Contrast. AdapterBackbone=GPT-Neo 1.3B, Evaluation Protocol=Contrastive Adapter2022.07 | 87.9 | 92.6 | 4.7 | |
| ERM LPBackbone=GPT-Neo 1.3B, Evaluation Protocol=ERM LP2022.07 | 87.2 | 93.3 | 6.1 | |
| ERM AdapterBackbone=GPT-Neo 1.3B, Evaluation Protocol=ERM Adapter2022.07 | 87.2 | 93.6 | 6.4 | |
| WiSE-FTBackbone=GPT-Neo 1.3B, Evaluation Protocol=WiSE-FT2022.07 | 87.2 | 93.3 | 6.1 | |
| DFR (Sub)Backbone=GPT-Neo 1.3B, Evaluation Protocol=DFR (Sub)2022.07 | 87.2 | 93.2 | 6 | |
| DFR (Up)Backbone=GPT-Neo 1.3B, Evaluation Protocol=DFR (Up)2022.07 | 85.4 | 92.7 | 7.3 | |
| Zero-shotBackbone=GPT-Neo 1.3B, Evaluation Protocol=Zero-shot2022.07 | 79.4 | 86.7 | 7.3 |