AndroidControl
Benchmarks
TaskDatasetSOTA resultTrendResults
AndroidControl Low
95.05SR (%)
40
AndroidControl
48.2Step Accuracy
34
AndroidControl High
75.8SR
30
AndroidControl High
76.3SR (Success Rate)
29
AndroidControl High
83.7Task Match (TM)
27
AndroidControl Low
91.8SR
24
AndroidControl (offline)
79.1Step Success Rate
23
AndroidControl Low v2
88.9Pass@1 Step Accuracy
22
AndroidControl High v2
68.59Pass@1 Step Accuracy
22
AndroidControl High
83.7Task Match Rate (TM)
22
AndroidControl Low (test)
93.7Task Success Rate
22
AndroidControl High Level v2
64.3Pass@1
20
AndroidControl Task-Unseen
62.3SSR
20
AndroidControl (High)
79.37SR
20
AndroidControl High
84.7Type Rate
17
AndroidControl
72.7Step Accuracy
16
AndroidControl Low
85.17Type
16
AndroidControl High-level
87.4Click TMR
15
AndroidControl Low-level
97.6TMR (Click)
15
AndroidControl Low
97.2Type Score
15
AndroidControl High
75.3Step Success Rate
15
AndroidControl 1.0 (test)
72.9Step Success Rate (SR)
15
AndroidControl Curated Easy
88.6Type Success Rate
15
AndroidControl Curated-Hard
80.8Type Rate
15
AndroidControl High (test)
80.3Success Rate (SR)
14