MNLI
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
adv-MNLI TextFooler-BERT
73.2Accuracy (Matched)
8
MNLI
91.7Accuracy
7
MNLI Length Match
65.7Accuracy
7
MNLI Negation Mismatch
54.2Accuracy
7
MNLI Negation Match
53.2Accuracy
7
MNLI
0.974Raw $
ho$
6
MNLI matched (val)
74.2Accuracy
6
MNLI -> SNLI (test)
0.049ECE
6
MNLI 3-Choice
9.9Delta Accuracy
6
MNLI (test)
78Total Transmitted Messages (KB)
6
MNLI Mismatched
0.41MAPE
6
MNLI Dir alpha=0.1
84.98Generalized Accuracy
6
MNLI Dir alpha=0.1 Standard
90.38Acc_p (Personalized)
6
MNLI
-42.1Clean Accuracy Change
6
MNLI
85.27Accuracy
5
MNLI
0.11RelMAE
5
MNLI mm
8,835Total Latency (s)
5
MNLI
6,462Max Memory (MB)
5
MNLI Case 8
15Gap Prediction Error
5
MNLI
0.09Gap Prediction Error
5
MNLI
0Epochs
5
MNLI
22.52Latency (ms)
4
MNLI (sample)
92.5Average Score
4
MNLI binary classification (test)
78.7ROC AUC
4
MNLI (test)
84.4Clean Accuracy
4