High-level instruction execution on AndroidControl task-UN
72.2Step AccuracyMobileIPL-7B
Evaluation results
| Method | Links | |
|---|---|---|
| MobileIPL-7BMode=IPL2025.05 | 72.2 | |
| Qwen2-VL-7B(GRPO)Mode=RL2025.05 | 69.7 | |
| OS-Atlas-7BMode=PF2025.05 | 66.2 | |
| Qwen2-VL-7B(SFT)Mode=FT2025.05 | 64.1 | |
| SphAgent-7BMode=PF2025.05 | 62.9 | |
| PaLM 2S(full)Mode=FT2025.05 | 59.7 | |
| PaLM 2S(LoRA)Mode=FT2025.05 | 59.6 | |
| FedMobileAgentMode=PF2025.05 | 51.2 |