Webshop
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Webshop
100Score
248
Webshop
91.5Score
115
WebShop
80.5Success Rate
80
WebShop
84.02Success Rate
77
WebShop
82.9Success Rate (SR)
72
WebShop semantic shift Hidden drift
100Score
63
WebShop (test)
95Score
59
WebShop
74.1Success Rate
59
WebShop
99Success Rate
57
WebShop
90.5Average Score
55
WebShop (test)
84.38SR
51
WebShop (test)
73Success Rate
42
WebShop
100CoT Match Rate
41
WebShop (Seen)
62.3Average Reward
40
WebShop
89.06Success Rate
39
WebShop (test)
97Success Rate
37
WebShop (test)
91.37Score
36
WebShop 128 tasks (test)
89.4Score
33
WebShop (val)
84.4Success Rate
31
WebShop
63.7Mean Reward
30
WebShop 128 (val)
89.4Score
30
WebShop-AC 1.0 (test)
92.6TSR
27
WebShop
81.3Strict Success
27
WebShop Source
100Success Rate
27
WebShop
39Real
24