WebWalker
Benchmarks
TaskDatasetSOTA resultTrendResults
WebWalker Hard
30Success Rate (SR)
25
WebWalker Medium
51.43Success Rate (SR)
25
WebWalker Easy
58.75Success Rate
25
WebWalker QA
76.5Accuracy
23
WebWalker
33.5WebWalker Accuracy
20
WebWalker 128K
27.44F1 Score
20
WebWalker
30.5F1 Score
18
WebWalker
53.5Success Rate (Config)
10
WebWalker
47.2Success Rate
9
WebWalker
72.7Accuracy
9
WebWalker
59.5Score
7
WebWalker
61.7Pass@1
6
WebWalker (WW)
37.2Pass@1
5
WebWalker
39.85Score
5
WebWalker 100 tasks (test)
0.125Success Rate (Easy)
4
WebWalker
33.02F1 Score
4