List your company

ResearchFormerly WizWand

Trivia QA

Benchmarks

TaskDatasetSOTA resultTrendResults

Trivia QA

82.2Accuracy

32

Passage Retrieval

Trivia QA (TQA)

81.3Top-20 Accuracy

17

Question Answering

Trivia QA

5.9Error Rate (ER)

12

Speech Question Answering

Trivia QA

39.1Speech QA Score

10

Question Answering

Trivia QA Hard

37.83F1 Score

9

Open-Domain Question Answering

Trivia QA

52.51Trivia QA Score

7

Short-form Question Answering

Trivia QA

85.9AUROC

7

Trivia QA (test)

83.2R@20

6

Membership Inference Attack Defense

Trivia-QA

0.491SPV AUC

4

Membership Inference Attack Defense

Trivia-QA (test)

0.55SPV AUC

4