WebArena
Benchmarks
TaskDatasetSOTA resultTrendResults
WebArena
61.7Overall Success Rate
138
WebArena (test)
15.45Average Task Completion
137
WebArena
35.8Success Rate
56
WebArena
70Success Rate (Gitlab)
32
WebArena Lite
61.8Average Success Rate
31
WebArena
53.7Success Rate
19
WebArena Lite v2
28.6Average Success Rate
19
WebArena
45.9Success Rate
19
WebArena Lite
21.2SR
18
WebArena (test)
42.9Shopping Success Rate
18
WebArena Overall 684 tasks
56.3Task Success Rate (SR)
15
WebArena Multi 29 tasks
20.7Task Success Rate (SR)
15
WebArena Reddit 106 tasks
83Success Rate (SR)
15
WebArena Gitlab 180 tasks
46.7Task Success Rate (SR)
15
WebArena 182 tasks (Admin)
58.2Success Rate (SR)
15
WebArena Shopping 187 tasks
54Task Success Rate
15
WebArena Lite v2
45.5Success Rate
14
WebArena
88.43Pairwise Accuracy
13
WebArena Average
50.74Success Rate
12
WebArena
27.8Task Success Rate (TSR)
12
WebArena (held-out)
90AUPRC
11
WebArena (test)
53.8Success Rate
10
WebArena
57.6Skill Step Percentage
9
WebArena
52.3Macro-Averaged Success Rate
9
WebArena Continual-memory deployment
52.3Success Rate (SR)
9