List your company

Mobile Navigation on GUIOdyssey updated evaluation set

79.2Step AccuracyAgentCPM-GUI-8B
27.30440.77754.2567.723Mar 9, 2026

Evaluation results

MethodLinks
AgentCPM-GUI-8BModel Type=Open-source Models, Parameter Scale=8B2026.0379.2
SecAgent-3BModel Type=Open-source Models, Parameter Scale=3B2026.0374.3
UI-Venus-Navi-7BModel Type=Open-source Models, Parameter Scale=7B2026.0371.1
OS-Atlas-7BModel Type=Open-source Models, Parameter Scale=7B2026.0365.2
Qwen2.5-VL-7BModel Type=Open-source Models, Parameter Scale=7B2026.0359.6
Qwen3-VL-8BModel Type=Open-source Models, Parameter Scale=8B2026.0353.8
Qwen3-VL-4BModel Type=Open-source Models, Parameter Scale=4B2026.0353.4
Qwen2.5-VL-3BModel Type=Open-source Models, Parameter Scale=3B2026.0349.3
Claude-3-SonnetModel Type=Closed-source Models2026.0346.5
GUI-R1-7BModel Type=Open-source Models, Parameter Scale=7B2026.0341.9
UI-TARS-7BModel Type=Open-source Models, Parameter Scale=7B2026.0337.5
GUI-R1-3BModel Type=Open-source Models, Parameter Scale=3B2026.0334.6
UI-R1-3BModel Type=Open-source Models, Parameter Scale=3B2026.0332.7
GPT-4oModel Type=Closed-source Models2026.0329.3