Natural Language Inference on RONLI (test)
75Micro F1 ScoreRo-BERT + Cart-Stra-CL++
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Ro-BERT + Cart-Stra-CL++Over sampling=true2024.05 | 75 | 59 | |
| Ro-BERT + STS-CLOver sampling=true2024.05 | 74 | 57 | |
| Ro-BERTOver sampling=true2024.05 | 73 | 56 | |
| Ro-BERT + AOver sampling=true2024.05 | 73 | 44 | |
| Ro-BERT + E2L + AOver sampling=true2024.05 | 73 | 44 | |
| Ro-BERT + Length-CLOver sampling=true2024.05 | 73 | 54 | |
| Ro-BERT + Cart-CL++Over sampling=true2024.05 | 73 | 57 | |
| Ro-BERTOver sampling=false2024.05 | 72 | 37 | |
| RoGPT2Over sampling=false2024.05 | 70 | 30 | |
| Ro-BERT + Cart-CLOver sampling=true2024.05 | 70 | 51 | |
| Ro-BERT (spurious)Over sampling=false2024.05 | 69 | 35 | |
| CBOW + SoftmaxOver sampling=false2024.05 | 66 | 36 | |
| Ro-BERT + E2LOver sampling=true2024.05 | 65 | 31 | |
| CBOW + SVMOver sampling=false2024.05 | 63 | 45 | |
| ChatGPT 3.5 Turbo2024.05 | 57 | 40 | |
| Fine-tuned multilingual BERTOver sampling=false2024.05 | 50 | 30 | |
| Ro-BERT + H2LOver sampling=true2024.05 | 31 | 12 | |
| Zero-shot multilingual BERTOver sampling=false2024.05 | 8 | 8 |