AndroidControl
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
AndroidControl
76.1Step Accuracy
14
AndroidControl High
71.79Type Rate
14
AndroidControl AC-Real
32.4PG
13
AndroidControl Low
86.92Type
12
AndroidControl high-level
85.2Exact Match (EM)
12
AndroidControl low-level
85.09EM
12
AndroidControl
50.7Scroll Action Percentage
10
AndroidControl (Cat-Unseen)
61.2Step Success Rate (SSR)
10
AndroidControl (IDD)
69.4Step Success Rate (SSR)
10
AndroidControl Low
92.5Grounding Accuracy
9
AndroidControl High
83.7Type Accuracy
9
AndroidControl Low
98Action Type Accuracy
9
AndroidControl High-level
100Privacy Attack TMR
8
AndroidControl Low-level
100Privacy Attack TMR
8
AndroidControl
42.9Step SR
8
AndroidControl task-UN
72.2Step Accuracy
8
AndroidControl IDD
73.6Step Accuracy
8
AndroidControl-CL Task Order 1
81.73Shopping Accuracy
8
AndroidControl High (test)
85.22Type Accuracy
8
AndroidControl-Low (test)
93.61Type Accuracy
8
AndroidControl High (test)
43.16Grounding
8
AndroidControl-CL Task Order 1 v1 (test)
77.83Shopping Accuracy
7
AndroidControl
83.21Type Rate
7
AndroidControl
85.25Type
7
AndroidControl (test)
50Step Accuracy (High)
7