ScreenSpot
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Screenspot Mobile
96.3Text Accuracy
18
ScreenSpot Standard Setting 1.0
94.1Accuracy (Mobile, Text)
15
ScreenSpot V2
90.5Average Accuracy
14
ScreenSpot Overall v2 (Aggregated)
92.1Average Grounding Accuracy
14
ScreenSpot-Pro (test)
40.8Accuracy (Development)
14
Screenspot V2
82.9Center Accuracy
14
ScreenSpot v2
92.8Accuracy
13
ScreenSpot v1 (test)
95.4Accuracy (Desktop, Text)
13
ScreenSpot-Pro macOS
41.39Grounding Accuracy
13
ScreenSpot v2 (test)
88Grounding Accuracy
13
ScreenSpot (test)
85.9Grounding Accuracy
13
ScreenSpot Web V1
93.5Text Accuracy
10
ScreenSpot Desktop V1
95.9Text Accuracy
10
ScreenSpot Mobile V1
97.8Text Grounding Accuracy
10
ScreenSpot Mobile
58.4Recall
10
ScreenSpot PC
59Recall
10
ScreenSpot Web
76.8Recall
10
ScreenSpot Overall
57.9Avg Action Success Rate
8
ScreenSpot (Web)
70.4Success Rate (Text Actions)
8
ScreenSpot Mobile
78Action Success Rate (Text)
8
ScreenSpot Desktop
74.2Success Rate (Text)
8
ScreenSpot-Pro
85.1Accuracy
7
ScreenSpot Agent Setting Standard
94.5Mobile Text Acc
7
ScreenSpot Web
69.1Action Score
6
ScreenSpot 1.0 (full)
0.78Mobile Text Acc
6