FiQA
Benchmarks
TaskDatasetSOTA resultTrendResults
FiQA 2018
42.05Accuracy
6
FiQA (test)
40.3nDCG@10
5
FiQA
99.4NDCG@5
5
FiQA
61.2Top-1 Accuracy
5
FiQA
0.524NDCG@10
5
FiQA nanoBEIR 2018 (slice)
64.63nDCG@10
4
FiQA (test)
76ASR
4
FiQA Financial
99MRR
4
FiQA
14.6Relative Improvement
4
FiQA 2018
0.721MRR@10
4
FIQA
507.03QPS
4
FiQA SA
75.07Score
4
FiQA
25.36nDCG@10
3
FiQA
1Runtime (min)
3
FiQA (test)
0.87Accuracy
3
FiQA Sentiment Dataset 2018 (test)
0.07MSE
3
FiQA BEIR v1.0 (test)
0.348nDCG@10
2
FiQA BEIR
0.15Latency (ms)
2
FiQA
0.35H2D Latency (ms)
1
FIQA Stratified
100MSC
1
FIQA Aggregate
60.9MSC
1
FiQA 57K docs
15.62Context Precision
1
fiqa v1 (test)
—Accuracy
0