Short-form Question Answering
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
68.4F1 Score
18
Jun 12, 2026
7.9ECE
18
Mar 4, 2026
40F1 Score
14
Jul 3, 2026
63.3Accuracy (Com. Sci.)
12
Feb 26, 2026
21.7Accuracy
11
Jul 9, 2026
50.6Accuracy
11
Jul 9, 2026
45.1Accuracy
11
Jul 9, 2026
77.3F1 Score
9
Jun 12, 2026
85.9AUROC
7
May 15, 2026
35.93EM
5
Feb 26, 2026
0.349EM
5
Feb 26, 2026
13.67EM
5
Feb 26, 2026
26.5EM
5
Feb 26, 2026
36.34Exact Match
5
Feb 26, 2026
50Exact Match
5
Feb 26, 2026
36EM
5
Feb 26, 2026