WEBQUESTIONS
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
WebQuestions (WebQs)
63.5Accuracy
67
WebQuestions
37Accuracy
66
WebQuestions (WebQ) (test)
57.8Exact Match (EM)
55
WebQuestions (WQ) Open-QA (test)
48.7Exact Match
38
WebQuestions (WQ) (test)
85.4Top-20 Accuracy
37
WebQuestions (test)
59.15Accuracy
36
WebQuestions (WQ)
63.97R@10
28
WEBQUESTIONS (test)
42.2F1 Score
27
WebQuestions
84.6Hits@1
19
WebQuestions (WebQ) (dev)
51.5Exact Match
17
WebQuestions
87.67AUROC
15
WebQuestions (WQ)
45.2Exact Match (EM)
15
WebQuestions
99.6WebQ Accuracy
14
WebQuestions (WebQS)
8.17WebQS Score
12
WebQuestions (test)
32.05METEOR
12
WebQuestions (test)
41.8F1 (Berant)
11
WebQuestions
52HALL Score
10
WebQuestions
78.2Accuracy
8
Webquestions
75.9Score
7
WebQuestions (WebQ) (test)
53.6Average F1
7
WebQuestions
40.8Text Score
6
WebQuestions first 1000 samples (dev)
30.6EM
6
WebQuestions
70.81F1 Score
5
WebQuestions (WQ) (test)
49.7Exact Match
5
WebQuestions (WebQ)
52.4CoverEM
4