WebVoyager
Benchmarks
TaskDatasetSOTA resultTrendResults
WebVoyager
93.4Success Rate
81
WebVoyager OOD
56.3Allrecipes
30
WebVoyager (test)
90.6Success Rate
18
WebVoyager
51.84Success Rate
16
WebVoyager
4.55Average Action Count
15
WebVoyager
90.6Success Rate
14
WebVoyager (test)
87Success Rate
14
WebVoyager curated subset of 129 tasks
65.9Success Rate (SR)
12
WebVoyager
88.89Success Rate (Allrecipes)
12
WebVoyager 1.0 (test)
62.5Allrecipes
12
WebVoyager
73.9Success Rate (Wolfram)
10
WebVoyager
0.15Spearman Correlation
8
WebVoyager Live Websites
38.7Success Rate (All Rec)
7
WebVoyager
60Allrecipes Success Rate
6
WebVoyager
4.73Avg Steps per Success
6
WebVoyager (online evaluation)
51.2Amazon
5
WebVoyager Easy
84.3Kimi K2 Success Rate
5
WebVoyager (test)
87.2Success Rate
4
WebVoyager
87Accuracy
3
WebVoyager
3.4Unterminated Rate (%)
2