List your company

ResearchFormerly WizWand

WEBQUESTIONS

Benchmarks

TaskDatasetSOTA resultTrendResults

Question Answering

WebQuestions (WebQs)

63.5Accuracy

67

Question Answering

WebQuestions

37Accuracy

66

Open-domain Question Answering

WebQuestions (WebQ) (test)

57.8Exact Match (EM)

55

Open-domain Question Answering

WebQuestions (WQ) Open-QA (test)

48.7Exact Match

38

Passage retrieval

WebQuestions (WQ) (test)

85.4Top-20 Accuracy

37

Open-domain Question Answering

WebQuestions (test)

59.15Accuracy

36

Passage Ranking

WebQuestions (WQ)

63.97R@10

28

Open Question Answering

WEBQUESTIONS (test)

42.2F1 Score

27

Open-Domain Question Answering

WebQuestions

84.6Hits@1

19

Open-Domain Question Answering

WebQuestions (WebQ) (dev)

51.5Exact Match

17

Hallucination detection

WebQuestions

87.67AUROC

15

Open-Domain Question Answering

WebQuestions (WQ)

45.2Exact Match (EM)

15

Question Answering

WebQuestions

99.6WebQ Accuracy

14

Open-domain Question Answering

WebQuestions (WebQS)

8.17WebQS Score

12

Knowledge Base Question Generation

WebQuestions (test)

32.05METEOR

12

Question Answering

WebQuestions (test)

41.8F1 (Berant)

11

Generative Question Answering

WebQuestions

52HALL Score

10

WebQuestions

78.2Accuracy

8

Audio-to-Text Chat

Webquestions

75.9Score

7

Knowledge Base Question Answering

WebQuestions (WebQ) (test)

53.6Average F1

7

Spoken Question Answering

WebQuestions

40.8Text Score

6

Question Answering

WebQuestions first 1000 samples (dev)

30.6EM

6

Question Answering

WebQuestions

70.81F1 Score

5

Question Answering

WebQuestions (WQ) (test)

49.7Exact Match

5

Question Answering

WebQuestions (WebQ)

52.4CoverEM

4