Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Webshop dataset and benchmarks – Page 3 · SOTA2 Research

Research Datasets

Webshop

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Interactive Agent Task

WEBSHOP

14Efficiency Multiplier

15

Agentic Reasoning

WebShop (test)

82.3Success Rate

15

Decision Making

WebShop

42.9Success Rate

15

Web Agent Interaction

WebShop

88.4Score

14

WebShop unseen (test)

87.2Score

14

WebShop

61Real Success Score

14

WebShop Implicit Hidden Drift

100Success Rate (Source)

14

WebShop Explicit Structural Drift II

95Success Rate (Source)

14

Web Navigation and E-commerce

WebShop In-Distribution

94.73Average Score

13

Target product selection

Webshop

98.3PRAC

13

Web Interaction

WebShop

39.2Pass@1

12

Interactive Decision Making

WebShop (val)

85.8Score

11

Partially Observable Decision Making

WebShop

83.5Score

11

Sequential Decision Making

WebShop

0.88Score

11

WebShop (val)

85.3Success Rate

11

Multi-turn Agentic Tool-use

WebShop

79.6Success Rate

10

Realistic shopping tasks

WebShop

35.6Success Rate (%)

10

Interactive Agent

WebShop

68.65Pass@1

10

WebShop LeaderBoard

64.1Greedy Score

9

Interactive web shopping and navigation

WebShop (val)

63.55Avg@8

9

WebShop Semantic Explicit structural drift (II)

95Success Rate

9

WebShop Semantic Explicit structural drift (Drift I)

95Success Rate

9

WebShop Explicit structural drift (Source)

100Success Rate

9

WebShop Semantic Shift baseline (Source)

9,500Success Rate

9

WebShop Standard (Source)

62.5Score

9

Page 3 of 5

Popular tasks

Web navigation Web Shopping Interactive Decision-making Online Shopping Web-based Agent Interaction

Follow for updates

Join SOTA2 Contact