Mind2Web
Benchmarks
TaskDatasetSOTA resultTrendResults
Mind2Web Cross-Website
364.1To_Pro Steps/Time
16
Mind2Web Cross-Task
378.2Time to Procedure
16
Mind2Web Live (test)
52.8Task Completion Rate
16
Multimodal-Mind2Web Cross-Task
50.7Element Accuracy
16
Mind2Web Service
36.27Success Rate
15
Mind2Web (Cross-website 177)
66.2Success Rate
14
Multimodal-Mind2Web Average
54.3Avg. Step Success Rate
14
Mind2Web Cross-Domain
85.7Operation F1
14
Mind2Web Cross-Task
87.6Operation F1 Score
14
Mind2Web Online (Average)
64Success Rate
13
Mind2Web
97.07Pairwise Acc
13
Mind2Web
39.84Task Performance
12
Mind2Web Online (live)
68.8Accuracy
12
Online-Mind2Web (Easy)
78.31Success Rate
12
Mind2Web Cross-Domain
35.7Element Accuracy
12
MT-Mind2Web Cross-Subdomain
52Element Accuracy
12
MT-Mind2Web (Cross-Website)
48.3Element Accuracy
12
Mind2Web Live
34.7Task Success Rate
11
Mind2Web (AVG)
66.8Execution Accuracy (EA)
11
Mind2Web (Cross-Website)
84.8Operation F1
11
MIND2WEB Cross-Website 1.0
47.6Element Accuracy
11
MIND2WEB Cross-Task 1.0
60.6Element Accuracy
11
Mind2Web Cross-domain
68.3Success Rate
10
Mind2Web Cross-website 1.0
47.1Success Rate
10
Mind2Web high-level setting new
49.08Accuracy
10