StrategyQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
StrategyQA abundant
82.9Accuracy
6
StrategyQA medium
81.4Accuracy
6
StrategyQA (scarce)
74.3Accuracy
6
StrategyQA multi-round
70.1Accuracy
6
StrategyQA 500 questions (test)
81.4Accuracy
5
StrategyQA (dev)
78.17Accuracy
5
StrategyQA sampled 50 (val)
90Accuracy
5
StrategyQA (dev)
79.8Accuracy
5
StrategyQA
0.36Correlation
5
StrategyQA (out-of-domain)
55.7Accuracy
4
StrategyQA
8.1Full Length Coverage
4
StrategyQA
88.4ASR
4
StrategyQA
52.29TCPS (s)
4
StrategyQA
5.461Causal Fidelity Score (CFS)
4
StrategyQA
64.3Accuracy
3
StrategyQA
77.32Pass@1
3
StrategyQA
23.3Perplexity
3
StrategyQA (SQA) (train)
37.8Auto-AIS (Before)
3
StrategyQA 200 Samples
46.96Planner Score
2
StrategyQA
3PTR Advancement
2
StrategyQA
69.4Accuracy
2
StrategyQA
54.8Accuracy (format-specific prompt)
2