Web task automation on VisualWebArena full
88.7SRHuman
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| HumanVisual=–2026.05 | 88.7 | 7.7 | — | — | — | — | — | |
| PANDO (Opus 4.6 + GPT-5.2)Visual=mixed2026.05 | 58.3 | 9.3 | 115 | 240 | 9.1 | 1.8 | 72.4 | |
| SGV (Gemini Flash)Visual=Screenshot + SoM2026.05 | 54 | 13.5 | 275 | 392.1 | 14.2 | 2.3 | 45.1 | |
| Gemini 3 ProCategory=Proprietary, Teacher for A3-SYNTH=true2026.04 | 49 | — | — | — | — | — | — | |
| WALT (Sonnet-4 + thinking)Visual=mixed2026.05 | 45.2 | 10.5 | 294 | 531.3 | 18.3 | 2.6 | 38.6 | |
| GPT-5.2 (M) + SoMVisual=Qwen-2.5VL2026.05 | 38.4 | 14.9 | 223 | 210.7 | 39.5 | 3.4 | 61.5 | |
| Qwen3.5-27BCategory=Open-weight (base)2026.04 | 37.4 | — | — | — | — | — | — | |
| Gemini 3.1 Flash L.Category=Proprietary2026.04 | 35 | — | — | — | — | — | — | |
| A3-Qwen3.5-9BCategory=A3 fine-tuned, Teacher=Gemini 3 Pro2026.04 | 33.9 | — | — | — | — | — | — | |
| GPT-5.2 (M) + SoMVisual=BLIP-22026.05 | 33.2 | 14.9 | 230 | 207.4 | 40.8 | 4.3 | 60.8 | |
| GPT-5.2 + SoMVisual=Qwen-2.5VL2026.05 | 31.6 | 17.6 | 290 | 181.5 | 33.9 | 3.7 | 64.2 | |
| A3-Qwen3.5-4BCategory=A3 fine-tuned, Teacher=Gemini 3 Pro2026.04 | 30.1 | — | — | — | — | — | — | |
| Qwen3.5-9BCategory=Open-weight (base)2026.04 | 28.5 | — | — | — | — | — | — | |
| GPT-5.2 + CaptionVisual=Qwen-2.5VL2026.05 | 24.8 | 31 | 166 | 388.7 | 2.1 | 1.9 | 10.3 | |
| Qwen3.5-4BCategory=Open-weight (base)2026.04 | 24.7 | — | — | — | — | — | — | |
| WACModel=Qwen3-VL-Plus2026.02 | 24.5 | — | — | — | — | — | — | |
| ReActModel=Qwen3-VL-Plus2026.02 | 22.7 | — | — | — | — | — | — | |
| WebDreamerModel=Qwen3-VL-Plus2026.02 | 22.7 | — | — | — | — | — | — | |
| GPT-5.2 Text-OnlyVisual=Acc. Tree2026.05 | 11.4 | 33.1 | 132 | 436.1 | 0.3 | 7.7 | 6.1 | |
| A3-Qwen3.5-2BCategory=A3 fine-tuned, Teacher=Gemini 3 Pro2026.04 | 7.6 | — | — | — | — | — | — | |
| Qwen3.5-2BCategory=Open-weight (base)2026.04 | 5.3 | — | — | — | — | — | — |