Visual Web Agent Navigation on DeepShop
68.7Success RateOpenWebRL-4B w/ OpenWebRL-Judge-8B
Evaluation results
| Method | Links | |
|---|---|---|
| OpenWebRL-4B w/ OpenWebRL-Judge-8Bbackbone=4B, # Steps=30, # Tasks=2.2k2026.06 | 68.7 | |
| OpenWebRL-8Bbackbone=8B, # Steps=30, # Tasks=2.2k2026.06 | 65.3 | |
| OpenWebRL-4Bbackbone=4B, # Steps=30, # Tasks=2.2k2026.06 | 64 | |
| Gemini computer-use-preview# Steps=100, # Tasks=–2026.06 | 62 | |
| Qwen3-VL-235B-A22B-Thinking# Steps=30, # Tasks=–2026.06 | 56.7 | |
| Gemini-3-flash (Axtree)# Steps=100, # Tasks=–2026.06 | 55.3 | |
| OpenWebRL-8B-SFTbackbone=8B, # Steps=30, # Tasks=0.9k2026.06 | 50 | |
| o3 (SoM)# Steps=100, # Tasks=–2026.06 | 49.7 | |
| GPT-5 (SoM)# Steps=100, # Tasks=–2026.06 | 49.1 | |
| OpenWebRL-4B-SFTbackbone=4B, # Steps=30, # Tasks=0.4k2026.06 | 48.7 | |
| Gemini-3-flash (Axtree)# Steps=30, # Tasks=–2026.06 | 45.1 | |
| Qwen3-VL-8B-Thinking# Steps=30, # Tasks=–2026.06 | 44 | |
| MolmoWeb-8B# Steps=100, # Tasks=>278.5k2026.06 | 42.3 | |
| GPT-5 (Axtree)# Steps=30, # Tasks=–2026.06 | 40.7 | |
| MolmoWeb-4B# Steps=100, # Tasks=>278.5k2026.06 | 35.6 | |
| Qwen3-VL-4B-Thinking# Steps=30, # Tasks=–2026.06 | 33.3 | |
| GLM-4.1V-9B-Thinking# Steps=100, # Tasks=–2026.06 | 32 | |
| Fara-7B# Steps=100, # Tasks=>123.2k2026.06 | 26.2 | |
| OpenAI computer-use-preview# Steps=100, # Tasks=–2026.06 | 24.7 | |
| GPT-4o (SoM)# Steps=100, # Tasks=–2026.06 | 16 | |
| UI-TARS-1.5-7B# Steps=100, # Tasks=–2026.06 | 11.6 |