QReCC
Benchmarks
TaskDatasetSOTA resultTrendResults
QReCC (test)
75.8Recall@10
43
QReCC
76.5R@10
29
QReCC (test)
57.4MRR
16
QReCC
31F1 Score
16
QReCC
31F1 Score
15
QReCC (test)
77.2R@10
13
QReCC (test)
120EM (%)
12
QReCC (test)
26.3F1 Score
10
QRECC Mean/Overall 1.0 (test)
64.7BLEU
9
QRECC Easy 1.0 (test)
82.79BLEU
9
QRECC Medium subset 1.0 (test)
63.17BLEU Score
9
QRECC Hard subset 1.0 (test)
0.495BLEU
9
QReCC
39.6NDCG@3
8
QReCC
53.37Top-1 Recall
7
QReCC (dev)
19.1Auto AIS (before)
3
QReCC large (test)
63.7Recall@10
2