Question Answering
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
4.72Prefill Speedup Ratio
12
Feb 26, 2026
3.39Prefilling Speedup Ratio
12
Feb 26, 2026
4.14Prefill Speedup Ratio
12
Feb 26, 2026
3.57Prefilling Speedup Ratio
12
Feb 26, 2026
84.63Hit
12
Feb 26, 2026
47.21EM
12
Feb 26, 2026
59.5Accuracy
12
Feb 26, 2026
78ASQA Score
12
Feb 26, 2026
70.4Accuracy
12
Feb 26, 2026
43.69Accuracy
12
Feb 26, 2026
80.85PIQA
12
Feb 26, 2026
32Accuracy
12
Feb 26, 2026
19.91F1 Score
12
Feb 26, 2026
21.25F1 Score
12
Feb 26, 2026
36.4F1 Score
12
Feb 26, 2026
36.3Exact Match (EM)
12
Feb 26, 2026
0.394OpenBookQA
12
Feb 26, 2026
0.19ROUGE-1
12
Feb 26, 2026
63.6Score
12
Feb 26, 2026
61.1Accuracy
12
Feb 26, 2026
79F1 Score
12
Feb 26, 2026
80.55F1
12
Feb 26, 2026
80.7F1
12
Feb 26, 2026
82.4Accuracy
12
Feb 26, 2026
86.9Accuracy
12
Feb 26, 2026