Classification on MNLI bias-free (test)
76Worst Group AccuracysDISCO
Evaluation results
| Method | Links | |
|---|---|---|
| sDISCOBackbone=TinyBERT, Footnote=†2025.06 | 76 | |
| GDROBackbone=TinyBERT2025.06 | 75.5 | |
| DISCOmBackbone=TinyBERT2025.06 | 75.1 | |
| IRMBackbone=TinyBERT2025.06 | 73.8 | |
| HSCICBackbone=TinyBERT2025.06 | 71.6 | |
| FishrBackbone=TinyBERT2025.06 | 64.5 | |
| c-MMDBackbone=TinyBERT2025.06 | 62.7 | |
| TinyBERTData=Biased (Lower Bound)2025.06 | 61.6 | |
| CIRCEBackbone=TinyBERT2025.06 | 51.6 | |
| AdversarialBackbone=TinyBERT2025.06 | 35.6 |