Web Agent Navigation on WebArena (test)
53.8Success RateGemini 3.1 Pro
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini 3.1 ProAgent harness=This work2026.04 | 53.8 | |
| Qwen3.5-27BParams=27B, Agent harness=This work2026.04 | 41.5 | |
| A3-Qwen3.5-9BParams=9B, Agent harness=This work2026.04 | 41.5 | |
| Claude 3.5 SonnetAgent harness=BrowserGym ecosystem2026.04 | 36 | |
| GPT-4oAgent harness=BrowserGym ecosystem2026.04 | 31.5 | |
| Qwen3.5-9B (base)Params=9B, Agent harness=This work2026.04 | 31 | |
| o1-miniAgent harness=BrowserGym ecosystem2026.04 | 29.9 | |
| Llama 3.1 405BParams=405B, Agent harness=BrowserGym ecosystem2026.04 | 22.6 | |
| Llama 3.1 70BParams=70B, Agent harness=BrowserGym ecosystem2026.04 | 17.1 | |
| GPT-4o-miniAgent harness=BrowserGym ecosystem2026.04 | 13.6 |