Natural Language Inference on ANLI R2 1.0 (test)
0.331Weighted F1ChaosNLI HJD
Evaluation results
| Method | Links | |
|---|---|---|
| ChaosNLI HJDBackbone=RoBERTa2024.12 | 0.331 | |
| MJD EstimatorBackbone=RoBERTa, LLM=Llama3, Explanations=Human2024.12 | 0.33 | |
| Label-Guided Explanation SelectionBackbone=RoBERTa, LLM=Llama3, Explanations=Model, Selection Strategy=VariErr Label-Guided2024.12 | 0.324 | |
| MJD EstimatorBackbone=RoBERTa, LLM=GPT-4o, Explanations=Human2024.12 | 0.324 | |
| Label-Guided Explanation SelectionBackbone=RoBERTa, LLM=GPT-4o, Explanations=Model, Selection Strategy=VariErr Label-Guided2024.12 | 0.324 | |
| VariErr distributionBackbone=RoBERTa2024.12 | 0.311 | |
| MJD EstimatorBackbone=RoBERTa, LLM=Llama3, Explanations=None2024.12 | 0.297 | |
| Label-Free Explanation SelectionBackbone=BERT, LLM=Llama3, Explanations=Model2024.12 | 0.295 | |
| MJD EstimatorBackbone=BERT, LLM=GPT-4o, Explanations=Human2024.12 | 0.294 | |
| Label-Guided Explanation SelectionBackbone=BERT, LLM=GPT-4o, Explanations=Model, Selection Strategy=VariErr Label-Guided2024.12 | 0.293 | |
| ChaosNLI HJDBackbone=BERT2024.12 | 0.289 | |
| MJD EstimatorBackbone=BERT, LLM=Llama3, Explanations=Human2024.12 | 0.289 | |
| Label-Guided Explanation SelectionBackbone=RoBERTa, LLM=Llama3, Explanations=Model, Selection Strategy=MNLI Label-Guided2024.12 | 0.287 | |
| Label-Guided Explanation SelectionBackbone=BERT, LLM=Llama3, Explanations=Model, Selection Strategy=VariErr Label-Guided2024.12 | 0.285 | |
| Label-Guided Explanation SelectionBackbone=BERT, LLM=Llama3, Explanations=Model, Selection Strategy=MNLI Label-Guided2024.12 | 0.283 | |
| Label-Free Explanation SelectionBackbone=BERT, LLM=GPT-4o, Explanations=Model2024.12 | 0.283 | |
| MJD EstimatorBackbone=RoBERTa, LLM=GPT-4o, Explanations=None2024.12 | 0.282 | |
| Label-Free Explanation SelectionBackbone=RoBERTa, LLM=GPT-4o, Explanations=Model2024.12 | 0.282 | |
| MJD EstimatorBackbone=BERT, LLM=Llama3, Explanations=None2024.12 | 0.276 | |
| MNLI distributionBackbone=RoBERTa2024.12 | 0.275 | |
| MNLI-FT-LMBackbone=BERT2024.12 | 0.269 | |
| MJD EstimatorBackbone=BERT, LLM=GPT-4o, Explanations=None2024.12 | 0.263 | |
| MNLI-FT-LMBackbone=RoBERTa2024.12 | 0.262 | |
| Label-Free Explanation SelectionBackbone=RoBERTa, LLM=Llama3, Explanations=Model2024.12 | 0.262 | |
| MNLI distributionBackbone=BERT2024.12 | 0.26 | |
| VariErr distributionBackbone=BERT2024.12 | 0.259 | |
| Out-of-the-box LMBackbone=BERT2024.12 | 0.176 | |
| Out-of-the-box LMBackbone=RoBERTa2024.12 | 0.167 |