StrategyQA
Benchmarks
TaskDatasetSOTA resultTrendResults
StrategyQA
95.7Accuracy
208
StrategyQA
0MAE
197
StrategyQA
94.4Accuracy
123
StrategyQA (test)
83.49Accuracy
119
StrategyQA (test)
96.7Task Accuracy
74
StrategyQA
83.5Accuracy
58
StrategyQA
89Accuracy
58
StrategyQA
95.6Accuracy
50
StrategyQA
85.59Exact Match (EM)
35
StrategyQA
80.1EM
35
strategyQA
83.2ACCL
32
StrategyQA (test)
100Factuality Acc
28
StrategyQA
80Accuracy
26
StrategyQA
90.4Accuracy
26
StrategyQA (test)
77.12Accuracy
26
StrategyQA
76.13Accuracy (%)
24
StrategyQA
0.285ECE
24
STRATEGYQA
61.8Accuracy
24
StrategyQA
66.7ACC
24
StrategyQA
89.34EM
21
StrategyQA
76.84Accuracy
20
StrategyQA
66.99Accuracy
20
StrategyQA (SQA)
76.95Cover-EM
20
StrategyQA
82Exact Match (EM)
16
StrategyQA
69.11Verifiability
16