Mobile device task automation on PhoneHarness (annotated evaluation)
75Overall Pass RatePhoneHarness
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| PhoneHarnessType=Harness2026.06 | 75 | 96.7 | 63.3 | 74.3 | 65.5 | |
| Seed2.0-ProType=Model2026.06 | 62.1 | 83.3 | 76.7 | 28.6 | 65.5 | |
| MobileClawType=Harness2026.06 | 62.1 | 93.3 | 63.3 | 48.6 | 44.8 | |
| AutoGLM-PhoneType=Model2026.06 | 37.1 | 43.3 | 43.3 | 20 | 44.8 |