Question Answering
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
0.388F1 Score
3
Feb 26, 2026
37.9F1 Score
3
Feb 26, 2026
91Accuracy
3
Feb 26, 2026
56Accuracy
3
Feb 26, 2026
78F1 Score
3
Feb 26, 2026
81Coverage
3
Feb 26, 2026
40.86Accuracy
3
Feb 26, 2026
68.33Accuracy
3
Feb 26, 2026
105.67Latency (s)
3
Feb 26, 2026
97.71Latency (s)
3
Feb 26, 2026
112.36Latency (s)
3
Feb 26, 2026
114.73Latency (s)
3
Feb 26, 2026
10.66Avg Relative Improvement
3
Feb 26, 2026
4.05SimpleQA Score
3
Feb 26, 2026
58Accuracy
3
Feb 26, 2026
50Accuracy
3
Feb 26, 2026
0.642Accuracy
3
Feb 26, 2026
34.2Accuracy
3
Feb 26, 2026
26.6EM
3
Feb 26, 2026
72.5Accuracy
3
Feb 26, 2026
72.88Answer EM
3
Feb 26, 2026
72.88Answer EM
3
Feb 26, 2026
73.5Answer EM
3
Feb 26, 2026
74.1Answer EM
3
Feb 26, 2026
69.5EM
3
Feb 26, 2026