EntityQuestions
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
EntityQuestions
538.31AUC Score
72
EntityQuestions
69.5Accuracy
20
EntityQuestions (test)
36Steered Accuracy
18
EntityQuestions Frequent
38.7Exact Match Accuracy
16
EntityQuestions (Infrequent)
38.6Exact Match (EM)
16
EntityQuestions (Long-tail)
36.4Exact Match Accuracy
16
EntityQuestions (test)
76.3Accuracy@20
15
ENTITYQUESTIONS Infrequent
75.4Recall@10
14
EntityQuestions (test)
74.5Recall@20 (macro average)
11
EntityQuestions unseen query distribution (test)
0.662Accuracy@20
8
ENTITYQUESTIONS Frequent
71.5Recall@10
7
ENTITYQUESTIONS Long-tail
54.6Recall@10
7
ENTITYQUESTIONS (Frequent)
81.9Recall@10
7
ENTITYQUESTIONS Long-tail
0.726Recall@10
7
EntityQuestions (ENTITYQ) (test)
28.3EM
7
EntityQuestions
79.8Acc@20
4