QNLI
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
QNLI
96.56Accuracy
93
QNLI (test)
93.3Accuracy
27
QNLI 64 instances (test)
91.1Accuracy
20
QNLI
92.45Accuracy
20
QNLI few-shot zero-shot
71.6Accuracy
16
QNLI
92.79Accuracy (%)
15
QNLI
82.5Exact Match
14
QNLI (test)
92.8Accuracy (Clean)
14
QNLI (test)
0.223ROUGE-L
12
QNLI (val)
88.05Accuracy
11
QNLI
0.91Kendall Correlation
10
QNLI Dir(0.1) (test)
88.83Accuracy
8
QNLI (test)
0.01SEAT e-size (Names: Career/Family)
8
QNLI
85.39Accuracy
8
QNLI
85.46Accuracy
8
QNLI standard (test dev)
92.1SAcc
6
QNLI (dev)
0.945Accuracy
6
QNLI (val)
77.09AUC
6
QNLI
3,011Total Running Time (s)
5
QNLI Case 9
0.18Gap Prediction Error
5
QNLI
0.14Generalization Gap Error
5
QNLI GLUE (test)
0.903Accuracy
5
QNLI
77.11AUC
5
QNLI
1,504.43End-to-End Latency (min)
4
QNLI Non-Biased
90.9Accuracy
4