SNLI
Benchmarks
TaskDatasetSOTA resultTrendResults
SNLI (test)
94.7Accuracy
694
SNLI
100Accuracy
218
SNLI (train)
99.7Accuracy
154
SNLI (dev)
93.6Accuracy
71
SNLI Hypothesis
83LFR
37
SNLI Premise
0.759LFR
37
SNLI hard 1.0 (test)
84.48Accuracy
27
SNLI
0.989Delta AF
24
SNLI 3 cls.
0.009MSE
22
SNLI (randomly sampled)
8.57PPL (U)
20
SNLI 1.0 (test)
90.67Accuracy
19
SNLI (test)
43.76Sufficiency
16
SNLI-Neg
75.9Accuracy
14
SNLI
99.8ROC AUC
12
SNLI source: MNLI (test)
80.2Accuracy
12
SNLI
83.05Correlation Coefficient
10
SNLI Combined variant (test)
88.93Accuracy
10
SNLI Noise variant (test)
89.77Accuracy
10
SNLI Emoji variant (test)
88.96Accuracy
10
SNLI Slang variant (test)
92.8Accuracy
10
SNLI Original (test)
93.12Accuracy
10
SNLI
0.93Kendall Correlation
10
SNLI
18.5R@1
9
SNLI
72.59Macro-F1
9
SNLI
3.72Wasserstein Distance
9