Inquire-driven GUI Navigation on InquireBench Chinese
10.5SRInquireMobile
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| InquireMobileFramework=Model-based Framework, Backbone=Qwen2.5-VL-3B, Training Stage=Stage1 & Stage22025.08 | 10.5 | 49.5 | 0.83 | |
| GUI-R1-3BFramework=Model-based Framework2025.08 | 9.5 | 10.5 | 0.91 | |
| Claude-3.5-Sonnet v2Framework=AppAgent Framework2025.08 | 8.4 | — | — | |
| Qwen2.5-VL-72BFramework=AppAgent Framework2025.08 | 6.7 | — | — | |
| UI-R1-3BFramework=Model-based Framework2025.08 | 5.3 | 3.2 | 0.54 | |
| GUI-OwlFramework=Model-based Framework2025.08 | 5.3 | 1 | 0.8 | |
| InquireMobileFramework=Model-based Framework, Backbone=Qwen2.5-VL-3B, Training Stage=Stage22025.08 | 5.3 | 5.3 | 0.69 | |
| Gemini-2.5-proFramework=Mobile-Agent-E Framework2025.08 | 4.2 | — | — | |
| UI-R1-3B-EFramework=Model-based Framework2025.08 | 4.2 | 3.2 | 0.41 | |
| Qwen2.5-VL-3BFramework=Model-based Framework2025.08 | 4.2 | 2.1 | 0.33 | |
| Claude-3.5-Sonnet v2Framework=Mobile-Agent-E Framework2025.08 | 3.2 | — | — | |
| InquireMobileFramework=Model-based Framework, Backbone=Qwen2.5-VL-3B, Training Stage=Stage12025.08 | 3.2 | 17.9 | 0.24 | |
| GPT-4o-0806Framework=AppAgent Framework2025.08 | 2.1 | — | — | |
| GPT-4o-0806Framework=Mobile-Agent-E Framework2025.08 | 2.1 | — | — | |
| Gemini-2.5-proFramework=AppAgent Framework2025.08 | 1 | — | — | |
| Qwen2.5-VL-72BFramework=Mobile-Agent-E Framework2025.08 | 1 | — | — |