WebArena
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
WebArena Lite In-distribution
60Avg Score (GitLab)
9
WebArena-Lite OOD
0.18Average Score (Reddit)
9
WebArena Lite
47.9Success Rate
9
Augmented WebArena N = 662 (test)
96.6Context Recall (TCNP)
8
WebArena-Infinity
43.7Success Rate
8
WebArena (test)
3.9Latency (s)
8
WebArena
0.79Pearson Correlation Coefficient (r)
8
WebArena self-hosted websites
43.8Reddit SR
8
WebArena Lite 1.0 (test)
44.44Shopping Success
8
WebArena topology simulation seed=42 (n=50 per topology)
1.24Rho(B)-reduction
7
WebArena
46.5Accuracy
7
WebArena 812 tasks
71.2Success Rate
7
WebArena (evaluation)
29.1Success Rate (SR)
6
WebArena (test)
0.39Spearman Correlation Coefficient
6
WebArena (Final-3)
42.9Shopping Success Rate
6
WebArena Human
80.4Success Rate
6
WebArena All tasks
75.7Success Rate
6
WebArena full 812-task
71.6Success Rate
6
VisualWebArena Task A pseudo trajectories
19.5Action Rate
6
WebArena Multi-site
10.75Average Steps
6
WebArena (All)
7.71Average Steps
6
WebArena-Lite
0.34Average Reward
6
WebArena (refactored)
86.3Success Rate
6
WebArena shopping_admin 12-task Warm (Run 2)
6.25Success Rate
5
WebArena shopping_admin 12-task subset (Cold) (Run 1)
7.25Success Rate
5