Web Navigation on MMInA Shop
48.5Success RateMem-W-8B
Evaluation Results
| Method | Links | |
|---|---|---|
| Mem-W-8BBackbone=UI-Venus-1.5-8B2026.05 | 48.5 | |
| Mem-W-4BBackbone=Qwen3-VL-4B2026.05 | 40.5 | |
| Qwen3-VL-32BModel Class=Open-source Native Models2026.05 | 36 | |
| Mem-W-7BBackbone=UI-TARS-1.5-7B2026.05 | 32.5 | |
| GLM-4.1V-9B-ThinkingModel Class=Open-source Native Models2026.05 | 28.5 | |
| Qwen3-VL-8BModel Class=Open-source Native Models2026.05 | 19.5 | |
| Step-GUI-4BModel Class=Open-source Native Models2026.05 | 19.5 | |
| UI-Venus-1.5-8BModel Class=Mem-W Models2026.05 | 18.5 | |
| Qwen2.5-VL-7BModel Class=Open-source Native Models2026.05 | 16 | |
| UI-Venus-1.5-30B-A3BModel Class=Open-source Native Models2026.05 | 13.5 | |
| Qwen3-VL-4BModel Class=Mem-W Models2026.05 | 11.5 | |
| Qwen3-VL-2BModel Class=Open-source Native Models2026.05 | 9.5 | |
| UI-TARS-1.5-7BModel Class=Mem-W Models2026.05 | 5.5 | |
| GUI-Owl-1.5-8BModel Class=Open-source Native Models2026.05 | 5 | |
| MAI-UI-2BModel Class=Open-source Native Models2026.05 | 2.5 |