Browser-use on DeepShop
0.62Success RateGemini computer-use-preview
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini computer-use-previewModel Category=API only, Modality=w/ vision, # Steps=1002026.04 | 0.62 | |
| Axtree Agent (Gemini-3-flash)Model Category=API only, Modality=w/o vision, # Steps=1002026.04 | 0.553 | |
| SoM Agent (o3)Model Category=API only, Modality=w/ vision, # Steps=1002026.04 | 0.497 | |
| SoM Agent (GPT-5)Model Category=API only, Modality=w/ vision, # Steps=1002026.04 | 0.491 | |
| Axtree Agent (Gemini-3-flash)Model Category=API only, Modality=w/o vision, # Steps=302026.04 | 0.451 | |
| MolmoWeb-8BModel Category=Open weight, # Steps=1002026.04 | 0.423 | |
| Axtree Agent (GPT-5)Model Category=API only, Modality=w/o vision, # Steps=302026.04 | 0.407 | |
| MolmoWeb-4BModel Category=Open weight, # Steps=1002026.04 | 0.356 | |
| GLM-4.1V-9B-ThinkingModel Category=Open weight, # Steps=1002026.04 | 0.32 | |
| Fara-7BModel Category=Open weight, # Steps=1002026.04 | 0.262 | |
| OpenAI computer-use-previewModel Category=API only, Modality=w/ vision, # Steps=1002026.04 | 0.247 | |
| SoM Agent (GPT-4o)Model Category=API only, Modality=w/ vision, # Steps=1002026.04 | 0.16 | |
| UI-TARS-1.5-7BModel Category=Open weight, # Steps=1002026.04 | 0.116 |