Visual Web Navigation on WebGym OOD 2026 (test)
52.4Peak Success Rate (Easy)AsyncWebRL (full)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| AsyncWebRL (full)Model=Qwen3-VL-8B-Instruct2026.06 | 52.4 | 34.3 | 7.1 | 45.4 | |
| AsyncWebRL (full)Model=Qwen3-VL-8B-Thinking2026.06 | 51.8 | 35.1 | 11.3 | 44.4 | |
| WebGym (sync REINFORCE)Model=Qwen3-VL-8B-Instruct2026.06 | 50.9 | 24.1 | 4.8 | 42.9 | |
| AsyncWebRL-RAFT++Model=Qwen3-VL-8B-Thinking2026.06 | 47.3 | 30 | 5.2 | 40.5 | |
| AsyncWebRL-RAFT++Model=Qwen3-VL-8B-Instruct2026.06 | 46.6 | 27.8 | 5.5 | 39.3 | |
| Base (no RL)Model=Qwen3-VL-8B-Thinking2026.06 | 37.4 | 24.3 | 1.2 | 32 | |
| Base (no RL)Model=Qwen3-VL-8B-Instruct2026.06 | 32.5 | 11.2 | 0 | 26.2 |