Search
Benchmarks
Dataset NameSOTA methodMetricTrendResultsLast Updated
54.9Accuracy
19
May 6, 2026
77.9Score
19
Jul 2, 2026
4Search Time (minute)
18
Jun 5, 2026
68.7Accuracy
17
May 6, 2026
61Pass@4
16
May 28, 2026
42Pass@4
16
May 28, 2026
46.1Pass@1
16
May 28, 2026
25.9Pass@1
16
May 28, 2026
82.4Score
15
Jul 2, 2026
83.99Hit Rate @ 5
15
Feb 26, 2026
45.8Accuracy
14
May 6, 2026
54.2Score
12
Jul 2, 2026
78Accuracy
9
May 6, 2026
74Score
9
Mar 17, 2026
59.5Score
7
Feb 26, 2026
70.5Score
7
Feb 26, 2026
100AURC (% of max)
5
Mar 24, 2026
0Mean Normalized Performance Drop
5
Mar 24, 2026
162.24Average Completion Time (timesteps)
3
Mar 4, 2026
104.25Average Completion Time (timesteps)
3
Mar 4, 2026
63.21Average Completion Time (timesteps)
3
Mar 4, 2026
27.1F1 Score
2
Feb 26, 2026