StrategyQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
StrategyQA
83.4Accuracy
16
STRATEGYQA
0.273Somers' D
15
StrategyQA
69.5Accuracy (StrategyQA)
14
StrategyQA
51.57Reusability Score
12
StrategyQA
3.39Prefilling Speedup Ratio
12
StrategyQA (unseen)
42.65Average Success Count (M.)
12
StrategyQA
0.94Pearson r
11
StrategyQA (test)
64.63Accuracy
11
StrategyQA
85.67Accuracy (ACC)
11
StrategyQA
76.27Accuracy
10
StrategyQA
78.89Accuracy
10
StrategyQA (first 300 questions)
64.67Average Accuracy
10
StrategyQA
99.5Topic Entropy
10
StrategyQA 100-query benchmark
69.8Mean Score
10
StrategyQA
3Attack Success Rate (ASR)
9
StrategyQA
70.6AUROC
9
StrategyQA
65.9Precision
9
StrategyQA
96Pass@1
8
StrategyQA
0.217ECE
8
StrategyQA
59.6Factuality
8
StrategyQA (test)
0.283RORA
8
StrategyQA
85.4Accuracy
7
StrategyQA
70.3Exact-match Accuracy
6
StrategyQA
64.4Accuracy (Step)
6
StrategyQA
32.2Clean Error
6