Natural Language Inference on ANLI R3 1.0 (test)
34.9Weighted F1MJD Estimator
Evaluation results
| Method | Links | |
|---|---|---|
| MJD EstimatorBackbone=BERT, LLM=Llama3, Explanations=Human2024.12 | 34.9 | |
| Label-Guided Explanation SelectionBackbone=BERT, LLM=Llama3, Explanations=Model, Selection Strategy=VariErr Label-Guided2024.12 | 34.9 | |
| MJD EstimatorBackbone=RoBERTa, LLM=Llama3, Explanations=Human2024.12 | 34.4 | |
| ChaosNLI HJDBackbone=RoBERTa2024.12 | 33.8 | |
| ChaosNLI HJDBackbone=BERT2024.12 | 33.2 | |
| MJD EstimatorBackbone=BERT, LLM=GPT-4o, Explanations=Human2024.12 | 33.2 | |
| Label-Guided Explanation SelectionBackbone=BERT, LLM=GPT-4o, Explanations=Model, Selection Strategy=VariErr Label-Guided2024.12 | 33 | |
| Label-Free Explanation SelectionBackbone=BERT, LLM=Llama3, Explanations=Model2024.12 | 32.8 | |
| MJD EstimatorBackbone=RoBERTa, LLM=GPT-4o, Explanations=Human2024.12 | 32.5 | |
| Label-Free Explanation SelectionBackbone=RoBERTa, LLM=Llama3, Explanations=Model2024.12 | 32.3 | |
| Label-Guided Explanation SelectionBackbone=RoBERTa, LLM=GPT-4o, Explanations=Model, Selection Strategy=VariErr Label-Guided2024.12 | 32.3 | |
| Label-Guided Explanation SelectionBackbone=BERT, LLM=Llama3, Explanations=Model, Selection Strategy=MNLI Label-Guided2024.12 | 32.1 | |
| VariErr distributionBackbone=RoBERTa2024.12 | 32.1 | |
| VariErr distributionBackbone=BERT2024.12 | 31.9 | |
| Label-Guided Explanation SelectionBackbone=RoBERTa, LLM=Llama3, Explanations=Model, Selection Strategy=VariErr Label-Guided2024.12 | 31.9 | |
| Label-Free Explanation SelectionBackbone=BERT, LLM=GPT-4o, Explanations=Model2024.12 | 31.5 | |
| Label-Free Explanation SelectionBackbone=RoBERTa, LLM=GPT-4o, Explanations=Model2024.12 | 31 | |
| Label-Guided Explanation SelectionBackbone=RoBERTa, LLM=Llama3, Explanations=Model, Selection Strategy=MNLI Label-Guided2024.12 | 30.7 | |
| MJD EstimatorBackbone=BERT, LLM=Llama3, Explanations=None2024.12 | 30.6 | |
| MJD EstimatorBackbone=RoBERTa, LLM=Llama3, Explanations=None2024.12 | 30.4 | |
| MJD EstimatorBackbone=RoBERTa, LLM=GPT-4o, Explanations=None2024.12 | 30.2 | |
| MJD EstimatorBackbone=BERT, LLM=GPT-4o, Explanations=None2024.12 | 29.5 | |
| MNLI-FT-LMBackbone=BERT2024.12 | 29.3 | |
| MNLI distributionBackbone=RoBERTa2024.12 | 28.1 | |
| MNLI distributionBackbone=BERT2024.12 | 27.9 | |
| MNLI-FT-LMBackbone=RoBERTa2024.12 | 25.7 | |
| Out-of-the-box LMBackbone=BERT2024.12 | 19.7 | |
| Out-of-the-box LMBackbone=RoBERTa2024.12 | 16.8 |