List your company

ResearchFormerly WizWand

Webshop

Benchmarks

TaskDatasetSOTA resultTrendResults

Interactive Agent Task

WEBSHOP

14Efficiency Multiplier

15

Agentic Reasoning

WebShop (test)

82.3Success Rate

15

Decision Making

WebShop

42.9Success Rate

15

Web Agent Interaction

WebShop

88.4Score

14

WebShop unseen (test)

87.2Score

14

WebShop

61Real Success Score

14

WebShop Implicit Hidden Drift

100Success Rate (Source)

14

WebShop Explicit Structural Drift II

95Success Rate (Source)

14

Web Navigation and E-commerce

WebShop In-Distribution

94.73Average Score

13

Target product selection

Webshop

98.3PRAC

13

Web Interaction

WebShop

39.2Pass@1

12

Interactive Decision Making

WebShop (val)

85.8Score

11

Partially Observable Decision Making

WebShop

83.5Score

11

Sequential Decision Making

WebShop

0.88Score

11

WebShop (val)

85.3Success Rate

11

Multi-turn Agentic Tool-use

WebShop

79.6Success Rate

10

Realistic shopping tasks

WebShop

35.6Success Rate (%)

10

Interactive Agent

WebShop

68.65Pass@1

10

WebShop LeaderBoard

64.1Greedy Score

9

Interactive web shopping and navigation

WebShop (val)

63.55Avg@8

9

WebShop Semantic Explicit structural drift (II)

95Success Rate

9

WebShop Semantic Explicit structural drift (Drift I)

95Success Rate

9

WebShop Explicit structural drift (Source)

100Success Rate

9

WebShop Semantic Shift baseline (Source)

9,500Success Rate

9

WebShop Standard (Source)

62.5Score

9