List your company
ResearchFormerly WizWand

Natural Language Inference on ANLI R1 (test)

44.3AccuracyGLaM
15.59623.04830.537.952Dec 13, 2021Jun 14, 2022Dec 15, 2022Jun 16, 2023Dec 17, 2023Jun 17, 2024Dec 18, 2024
Updated 8mo ago

Evaluation results

MethodLinks
GLaMModel Size=64B/64E, Evaluation Protocol=Few-shot, Shots=22021.1244.3
GLaMModel Size=64B/64E, Evaluation Protocol=One-shot2021.1242.4
VariErr distributionEvaluation Model=RoBERTa2024.1240.2
GLaMModel Size=64B/64E, Evaluation Protocol=Zero-shot2021.1239.2
GPT-3Model Size=175B, Evaluation Protocol=Few-shot, Shots=502021.1236.8
VariErr Label-GuidedEvaluation Model=RoBERTa, Explanations=Model-generated2024.1236.2
Mixtral (MJD) + human explanationsEvaluation Model=RoBERTa, Explanations=Human2024.1236.1
ChaosNLI HJDEvaluation Model=RoBERTa2024.1235.7
GPT-3Model Size=175B, Evaluation Protocol=Zero-shot2021.1234.6
Mixtral (MJD) + human explanationsEvaluation Model=BERT, Explanations=Human2024.1234.4
VariErr Label-GuidedEvaluation Model=BERT, Explanations=Model-generated2024.1234
MNLI Label-GuidedEvaluation Model=RoBERTa, Explanations=Model-generated2024.1232.9
GPT-3Model Size=175B, Evaluation Protocol=One-shot2021.1232
MNLI distributionEvaluation Model=RoBERTa2024.1231.7
VariErr distributionEvaluation Model=BERT2024.1230.2
MNLI-FT-LMEvaluation Model=RoBERTa2024.1229.2
MNLI Label-GuidedEvaluation Model=BERT, Explanations=Model-generated2024.1227.5
ChaosNLI HJDEvaluation Model=BERT2024.1226.8
Label-FreeEvaluation Model=BERT, Explanations=Model-generated2024.1225.2
Mixtral (MJD)Evaluation Model=BERT, Explanations=None2024.1224.2
Label-FreeEvaluation Model=RoBERTa, Explanations=Model-generated2024.1224.2
Mixtral (MJD)Evaluation Model=RoBERTa, Explanations=None2024.1223
MNLI distributionEvaluation Model=BERT2024.1222.9
MNLI-FT-LMEvaluation Model=BERT2024.1222
Out-of-the-box LMEvaluation Model=BERT2024.1217
Out-of-the-box LMEvaluation Model=RoBERTa2024.1216.7