Web Agent Navigation on VisualWebArena (test)
47.9Success RateGemini 3.1 Pro
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini 3.1 ProAgent harness=This work2026.04 | 47.9 | |
| Qwen3.5-27BParams=27B, Agent harness=This work2026.04 | 37.4 | |
| A3-Qwen3.5-9BParams=9B, Agent harness=This work2026.04 | 33.9 | |
| Qwen3.5-9B (base)Params=9B, Agent harness=This work2026.04 | 28.5 | |
| GPT-4oAgent harness=BrowserGym ecosystem2026.04 | 26.3 | |
| Claude 3.5 SonnetAgent harness=BrowserGym ecosystem2026.04 | 22 | |
| GPT-4o-miniAgent harness=BrowserGym ecosystem2026.04 | 18 |