Web Navigation on Mind2Web
58.7Overall Success RateTriton-GRPO-32B
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Triton-GRPO-32BSize=32B2026.04 | 58.7 | — | — | — | 70.1 | — | |
| CogAgentRepresentations of screen inputs=Image, Element selection candidates=top-502023.12 | 58.2 | 62.3 | 54 | 59.4 | — | — | |
| LLaMA2-70BRepresentations of screen inputs=HTML, Element selection candidates=top-502023.12 | 54.4 | 55.8 | 51.6 | 55.7 | — | — | |
| Triton-ORPO-32BSize=32B2026.04 | 53.2 | — | — | — | 63.4 | — | |
| LLaMA2-7BRepresentations of screen inputs=HTML, Element selection candidates=top-502023.12 | 50.1 | 52.7 | 47.1 | 50.3 | — | — | |
| Triton-SFT-32BSize=32B2026.04 | 47.6 | — | — | — | 60.5 | — | |
| Flan-T5XLRepresentations of screen inputs=HTML, Element selection candidates=top-102023.12 | 43.5 | 52 | 38.9 | 39.6 | — | — | |
| GPT-4.5-preview-2025-02-272026.04 | 42.4 | — | — | — | 59.8 | — | |
| Gemini-2.5-pro-preview-05-062026.04 | 41.5 | — | — | — | 59.1 | — | |
| Claude-4-5-noThink2026.04 | 41.4 | — | — | — | 58.8 | — | |
| Grok-32026.04 | 41.1 | — | — | — | 58.5 | — | |
| o4-mini-2025-04-162026.04 | 39.2 | — | — | — | 56.8 | — | |
| Gemini-2.5-Flash-preview-04-172026.04 | 38 | — | — | — | 55.3 | — | |
| Grok-3-fast2026.04 | 36.6 | — | — | — | 54.2 | — | |
| Gemini-2.0-Flash2026.04 | 35 | — | — | — | 53.1 | — | |
| GPT-4.1-mini-2025-04-142026.04 | 33.2 | — | — | — | 52 | — | |
| GPT-4Representations of screen inputs=HTML, Few-shot=true, Element selection candidates=top-102023.12 | 30.9 | 36.2 | 30.1 | 26.4 | — | — | |
| GPT-4.1-nano-2025-04-142026.04 | 28.4 | — | — | — | 48.4 | — | |
| DeepSeek-V3Size=37/671B2026.04 | 25.2 | — | — | — | 43.4 | — | |
| CogVLMRepresentations of screen inputs=Image, Element selection candidates=top-502023.12 | 23.9 | 37.1 | 23.4 | 26.3 | — | — | |
| Mem-W-8BBackbone=UI-Venus-1.5-8B2026.05 | 23.53 | — | — | — | — | — | |
| Mem-W-4BBackbone=Qwen3-VL-4B2026.05 | 22.55 | — | — | — | — | — | |
| Mem-W-7BBackbone=UI-TARS-1.5-7B2026.05 | 20.59 | — | — | — | — | — | |
| MAI-UI-2BModel Class=Open-source Native Models2026.05 | 19.41 | — | — | — | — | — | |
| Qwen3-32B-Instruct ChatSize=32B2026.04 | 17.7 | — | — | — | 36.9 | — | |
| GPT-3.5Representations of screen inputs=HTML, Few-shot=true, Element selection candidates=top-102023.12 | 17.4 | 18.6 | 17.4 | 16.2 | — | — | |
| Qwen3-VL-8BModel Class=Open-source Native Models2026.05 | 13.73 | — | — | — | — | — | |
| Qwen3-VL-32BModel Class=Open-source Native Models2026.05 | 13.73 | — | — | — | — | — | |
| Qwen3-VL-4BModel Class=Mem-W Models2026.05 | 13.72 | — | — | — | — | — | |
| Step-GUI-4BModel Class=Open-source Native Models2026.05 | 12.75 | — | — | — | — | — | |
| Qwen3-4B-Instruct ChatSize=4B2026.04 | 11.2 | — | — | — | 29.7 | — | |
| GLM-4.1V-9B-ThinkingModel Class=Open-source Native Models2026.05 | 10.78 | — | — | — | — | — | |
| Qwen-VLRepresentations of screen inputs=Image, Element selection candidates=top-502023.12 | 10.2 | 12.6 | 10.1 | 8 | — | — | |
| Qwen2.5-VL-7BModel Class=Open-source Native Models2026.05 | 9.8 | — | — | — | — | — | |
| Qwen3-VL-2BModel Class=Open-source Native Models2026.05 | 9.8 | — | — | — | — | — | |
| GUI-Owl-1.5-8BModel Class=Open-source Native Models2026.05 | 8.82 | — | — | — | — | — | |
| Qwen3-1.7B-Instruct ChatSize=1.7B2026.04 | 6.4 | — | — | — | 23.9 | — | |
| UI-TARS-1.5-7BModel Class=Mem-W Models2026.05 | 5.88 | — | — | — | — | — | |
| UI-Venus-1.5-8BModel Class=Mem-W Models2026.05 | 5.88 | — | — | — | — | — | |
| UI-Venus-1.5-30B-A3BModel Class=Open-source Native Models2026.05 | 3.92 | — | — | — | — | — | |
| Qwen3-0.6B-Instruct ThinkSize=0.6B2026.04 | 0 | — | — | — | 3.5 | — | |
| CogAgentbase_agent=CogAgent2026.06 | — | — | — | — | — | 41.2 | |
| CogAgent + VisCriticbase_agent=CogAgent, critic_module=VisCritic2026.06 | — | — | — | — | — | 44.7 | |
| Qwen2.5-VL Agentbase_agent=Qwen2.5-VL Agent2026.06 | — | — | — | — | — | 47.3 | |
| Qwen2.5-VL Agent + GUI-Critic-R1base_agent=Qwen2.5-VL Agent, critic_module=GUI-Critic-R12026.06 | — | — | — | — | — | 51.8 | |
| Qwen2.5-VL Agent + GUI-PRAbase_agent=Qwen2.5-VL Agent, critic_module=GUI-PRA2026.06 | — | — | — | — | — | 50.1 | |
| Qwen2.5-VL Agent + GuidNavbase_agent=Qwen2.5-VL Agent, critic_module=GuidNav2026.06 | — | — | — | — | — | 51.2 | |
| Qwen2.5-VL Agent + VisCriticbase_agent=Qwen2.5-VL Agent, critic_module=VisCritic2026.06 | — | — | — | — | — | 54.1 | |
| SeeClickbase_agent=SeeClick2026.06 | — | — | — | — | — | 33.4 | |
| SeeClick + BacktrackAgentbase_agent=SeeClick, critic_module=BacktrackAgent2026.06 | — | — | — | — | — | 36.9 | |
| SeeClick + GUI-Critic-R1base_agent=SeeClick, critic_module=GUI-Critic-R12026.06 | — | — | — | — | — | 37.2 | |
| SeeClick + GUI-PRAbase_agent=SeeClick, critic_module=GUI-PRA2026.06 | — | — | — | — | — | 36.2 | |
| SeeClick + VisCriticbase_agent=SeeClick, critic_module=VisCritic2026.06 | — | — | — | — | — | 37.6 | |
| ShowUIbase_agent=ShowUI2026.06 | — | — | — | — | — | 43.5 | |
| ShowUI + GUI-PRAbase_agent=ShowUI, critic_module=GUI-PRA2026.06 | — | — | — | — | — | 46.2 | |
| ShowUI + VisCriticbase_agent=ShowUI, critic_module=VisCritic2026.06 | — | — | — | — | — | 48.9 |