EntityQuestions
Benchmarks
TaskDatasetSOTA resultTrendResults
EntityQuestions
538.31AUC Score
72
EntityQuestions
69.5Accuracy
20
EntityQuestions (test)
36Steered Accuracy
18
EntityQuestions Frequent
38.7Exact Match Accuracy
16
EntityQuestions (Infrequent)
38.6Exact Match (EM)
16
EntityQuestions (Long-tail)
36.4Exact Match Accuracy
16
EntityQuestions (test)
76.3Accuracy@20
15
ENTITYQUESTIONS Infrequent
75.4Recall@10
14
EntityQuestions (test)
74.5Recall@20 (macro average)
11
EntityQuestions unseen query distribution (test)
0.662Accuracy@20
8
ENTITYQUESTIONS Frequent
71.5Recall@10
7
ENTITYQUESTIONS Long-tail
54.6Recall@10
7
ENTITYQUESTIONS (Frequent)
81.9Recall@10
7
ENTITYQUESTIONS Long-tail
0.726Recall@10
7
EntityQuestions (ENTITYQ) (test)
28.3EM
7
EntityQuestions
79.8Acc@20
4