Information Seeking
Benchmarks
Dataset NameSOTA methodMetricTrendResultsLast Updated
66.45Score
24
Jul 7, 2026
70.5Success Rate
23
Jul 1, 2026
51.5Pass@1
20
Feb 26, 2026
51.5Success Rate
19
Feb 26, 2026
58.1Pass@1
19
Feb 26, 2026
75Success Rate
18
Feb 26, 2026
75pass@1
17
Feb 26, 2026
75.7Pass@1
16
Feb 26, 2026
47.8Worst-case Weighted Payoff
8
Feb 26, 2026
235.7Worst-case Weighted Payoff
8
Feb 26, 2026
27Success Rate
6
Feb 26, 2026
1,821.5ELO Score
5
Apr 14, 2026
55.9Col-F1
5
Feb 26, 2026
27.1Accuracy
3
May 28, 2026
45Pass@1
2
Feb 26, 2026