High-level instruction execution on AndroidControl IDD
73.6Step AccuracyMobileIPL-7B
Evaluation results
| Method | Links | |
|---|---|---|
| MobileIPL-7BMode=IPL2025.05 | 73.6 | |
| OS-Atlas-7BMode=PF2025.05 | 71.2 | |
| PaLM 2S(LoRA)Mode=FT2025.05 | 70.8 | |
| Qwen2-VL-7B(GRPO)Mode=RL2025.05 | 70.2 | |
| SphAgent-7BMode=PF2025.05 | 69.4 | |
| Qwen2-VL-7B(SFT)Mode=FT2025.05 | 69.1 | |
| PaLM 2S(full)Mode=FT2025.05 | 65.5 | |
| FedMobileAgentMode=PF2025.05 | 54.7 |