Android GUI interaction on AndroTMem-Bench
46.14AMS ScoreGemini-3-Flash
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Gemini-3-FlashAgent Category=Closed-Source2026.03 | 46.14 | 55.21 | |
| UI-TARS-1.5-7BAgent Category=Open-Source2026.03 | 35.62 | 34.55 | |
| Gemini-2.5-ProAgent Category=Closed-Source2026.03 | 32.71 | 41.11 | |
| Qwen2.5-VL-7BAgent Category=Open-Source2026.03 | 20.71 | 16.04 | |
| COLAAgent Category=Multi-Agent2026.03 | 17.22 | 11.85 | |
| Mobile-Agent-EAgent Category=Multi-Agent2026.03 | 15.77 | 11.71 | |
| Gemini-2.5-FlashAgent Category=Closed-Source2026.03 | 15.62 | 14.51 | |
| GPT-4oAgent Category=Closed-Source2026.03 | 14.24 | 11.75 | |
| InfiGUI-R1Agent Category=Open-Source2026.03 | 14.12 | 9.2 | |
| UI-Venus-Navi-7BAgent Category=Open-Source2026.03 | 14.08 | 9.64 | |
| AgentCPM-GUI-8BAgent Category=Open-Source2026.03 | 14.06 | 10.49 | |
| GPT-5Agent Category=Closed-Source2026.03 | 12.37 | 11.46 |