SQA
Benchmarks
TaskDatasetSOTA resultTrendResults
SQA
93.5Accuracy
86
SQA
98Accuracy (SQA)
52
SQA IMG
70.7Accuracy
51
SQA-I
79Score
38
SQA
96.6SQA Score
36
SQA (test)
74.5Accuracy (All)
33
SQA-Image
70.2Accuracy
25
SQA
79.62Accuracy
24
SQA
85Accuracy
23
SQA IMG
97.67Score
23
SQA
97SQA Score
22
SQA v2
87.7Overall Score
21
SQA
71.6EM
21
SQA
70.15Score
20
SQA
69.91SQA Score
19
SQA v2
88.3Score
18
SQA (val)
79.92Accuracy
17
SQA
98.76Exact Match
14
SQA-I
67.9Accuracy
13
SQA CS V2 (test)
57.62IR
12
SQA (test)
72.4Accuracy (All)
11
SQA Perturbed (test)
0.723Overall Accuracy
8
SQA CS V2
89.7Overall Score
6
SQA (test)
53.32EM@1
5
SQA
74.5Overall Accuracy
5