Web Agent Navigation on WorkArena L1 (full)
79.4Success RateGemini 3.1 Pro
Evaluation Results
| Method | Links | |
|---|---|---|
| Gemini 3.1 ProAgent harness=This work2026.04 | 79.4 | |
| Qwen3.5-27BParams=27B, Agent harness=This work2026.04 | 57 | |
| o1-miniAgent harness=BrowserGym ecosystem2026.04 | 56.7 | |
| Claude 3.5 SonnetAgent harness=BrowserGym ecosystem2026.04 | 56.4 | |
| A3-Qwen3.5-9BParams=9B, Agent harness=This work2026.04 | 51.5 | |
| GPT-4oAgent harness=BrowserGym ecosystem2026.04 | 45.5 | |
| Llama 3.1 405BParams=405B, Agent harness=BrowserGym ecosystem2026.04 | 43.3 | |
| Qwen3.5-9B (base)Params=9B, Agent harness=This work2026.04 | 33.3 | |
| Llama 3.1 70BParams=70B, Agent harness=BrowserGym ecosystem2026.04 | 27.9 | |
| GPT-4o-miniAgent harness=BrowserGym ecosystem2026.04 | 27 |