QQP
Benchmarks
TaskDatasetSOTA resultTrendResults
QQP
91.7Accuracy
78
QQP (test)
95.3Accuracy
51
QQP
88.8Accuracy
44
QQP
33BLEU
22
QQP (test)
41.74BLEU-2
22
QQP Out-of-distribution from PAWS
70.8Macro F1
20
QQP
34.13BLEU
19
QQP
66ROUGE-L
18
QQP
0.314BLEU
17
QQP
0RDC
16
QQP few-shot zero-shot
74Accuracy
16
QQP
79.2Accuracy
15
QQP
85.7BS
12
QQP source: RTE (test)
71.5Accuracy
12
QQP
90.26Semantic Faithfulness
11
QQP
89F1 Score
10
QQP Out-of-distribution from PIT
0.757Macro F1
10
QQP -> WMT (test)
85.1AUROC
10
QQP
0.95Kendall Correlation
10
QQP Dir(0.1) (test)
88.28Accuracy
8
QQP
20ASR
8
QQP IID
84.8Accuracy
8
QQP
80.1Accuracy
8
QQP
80.76Accuracy
8
QQP
71.2Average Accuracy
8