Mind2Web
Benchmarks
TaskDatasetSOTA resultTrendResults
Mind2Web Cross-Task
53.2Step Success Rate
68
Mind2Web Cross-Domain
68.4Element Accuracy (EA)
64
Mind2Web (Cross-Website)
57.2Element Accuracy
44
MIND2WEB ONLINE (test)
67Task Success Rate (Overall)
41
Mind2Web
58.7Overall Success Rate
41
Mind2Web Cross-Domain
55.7Ele.Acc
41
Mind2Web Online
67.3Overall Average Score
37
Multimodal-Mind2Web Cross-Domain
67.1Step Success Rate
32
Multimodal-Mind2Web Cross-Task
71.5Step Success Rate
32
Mind2Web Cross-Task
66Element Accuracy
30
Mind2Web All
70Element Accuracy
27
Mind2Web Cross-Domain 1.0
445Success Rate
26
Mind2Web Cross-Task 1.0
49.2Success Rate
26
Mind2Web
45.68Success Rate
24
Mind2Web 600 tasks (test)
46.2ASR (Finance, pass@10)
24
Mind2Web 600 tasks (test)
54.1ASR Finance (pass@10)
24
Mind2Web (Cross-Website)
44.6Element Accuracy
23
MM-Mind2Web
22.97Step Success Rate (SR)
22
Mind2Web-SC
33.3Task Success Rate (TSR)
20
Mind2Web Cross-task
64.6Success Rate
18
Mind2Web
60.3Success Rate
17
Mind2Web (cross-website)
44.79Action Accuracy
17
Mind2Web All 1.0
0.484Element Accuracy
16
Mind2Web (All)
363.6Time to Proposal Steps
16
Mind2Web Cross-Domain
334.9To_Pro (Steps/Time)
16