Web Navigation and Task Automation on VisualWebArena 910 tasks (Full)
88.7Success Rate (%)Human
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Human2026.05 | 88.7 | — | — | — | |
| PANDOOptimization=Skill-library and supplementary optimization2026.05 | 58.3 | 0.085 | 0.085 | 1 | |
| SGV (Gemini-2.5 Flash)Backbone=Gemini-2.5 Flash, Verification=Two-pass self-grounded verifier2026.05 | 54 | 0.371 | 0.371 | 2.2 | |
| WALTBudget=One-time offline tool-discovery included in amortized2026.05 | 45.2 | 0.592 | 0.641 | — | |
| GPT-5.2 (M) + SoM (Qwen-2.5VL)Modalities=Multimodal (M), Prompting=SoM, Vision Model=Qwen-2.5VL2026.05 | 38.4 | 0.252 | 0.252 | 0.77 | |
| GPT-5.2 (M) + SoM (BLIP-2)Modalities=Multimodal (M), Prompting=SoM, Vision Model=BLIP-22026.05 | 33.2 | 0.258 | 0.258 | 0.79 | |
| GPT-5.2 + SoM (Qwen-2.5VL)Prompting=SoM, Vision Model=Qwen-2.5VL2026.05 | 31.6 | 0.318 | 0.318 | 0.97 | |
| GPT-5.2 + CaptionPrompting=Caption2026.05 | 24.8 | 0.345 | 0.345 | 1.05 | |
| GPT-5.2 Text-OnlyPrompting=Text-Only2026.05 | 11.4 | 0.328 | 0.328 | 1 |