SNLI
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
delta-SNLI
88.9Accuracy
9
δ-SNLI
81.6Accuracy
9
SNLI 1.0 (train)
93.1Accuracy
9
SNLI
22.1ASR
8
SNLI
255Fine-tuning Rounds
8
SNLI
131.39VRAM
8
SNLI Counterfactual
59.9Accuracy
8
SNLI In-Domain (test)
91.68Accuracy
8
adv-SNLI TextFooler-RoBERTa
52.6Accuracy
8
adv-SNLI TextFooler-BERT
62.3Accuracy
8
SNLI standard (test)
89.1F1 Score
7
SNLI
88.2Accuracy
6
SNLI 3-Choice
11.7ΔAcc
6
SNLI
0.243Faithfulness Score
6
SNLI
0.355Faithfulness Score
6
SNLI
0.457Faithfulness Score
6
SNLI
2.1MAPE (%)
6
SNLI Dir alpha=0.1
86.45Accuracy
6
SNLI Dir alpha=0.1 Standard
97.57Personalized Accuracy (Acc_p)
6
SNLI (test)
85.5Attack Success Rate
6
SNLI-3K (test)
89Accuracy
6
SNLI-3K (val)
92.3Accuracy
6
SNLI adversarial (test)
58.7Accuracy
6
SNLI 1000 random examples (test)
83.5Genetic Score
5
SNLI (val)
86.86Accuracy
5