Web Navigation on Mind2Web Live (test)
52.8Task Completion RateGPT-4o
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| GPT-4oModel Category=API-based Models2025.02 | 52.8 | 58.5 | 44.6 | 25.3 | |
| GPT-4oModel Category=API-based Models2025.02 | 50.4 | 56.4 | 44.2 | 22.1 | |
| Qwen2-72B-Instr.Model Category=Open-source Instructed Models2025.02 | 40.9 | — | — | 15.4 | |
| Qwen2-72B-Instr.Model Category=Open-source Instructed Models2025.02 | 40.9 | — | — | 15.4 | |
| Explorer-7BModel Category=Supervised Fine-Tuning2025.02 | 40.2 | 45.3 | 34.9 | 19.3 | |
| Explorer-4BModel Category=Supervised Fine-Tuning2025.02 | 39.4 | 44 | 31.3 | 18.1 | |
| Explorer-7BModel Category=Supervised Fine-Tuning2025.02 | 36.9 | 42 | 32.7 | 16.4 | |
| Explorer-4BModel Category=Supervised Fine-Tuning2025.02 | 36.7 | 41.6 | 30.8 | 16.4 | |
| GPT-3.5Model Category=API-based Models2025.02 | 36.5 | — | — | 15.4 | |
| GPT-3.5Model Category=API-based Models2025.02 | 36.5 | — | — | 15.4 | |
| Qwen2-VL-7BModel Category=Open-source Instructed Models2025.02 | 35.4 | 40.2 | 34.9 | 14.5 | |
| Qwen2-VL-7BModel Category=Open-source Instructed Models2025.02 | 33.3 | 37.9 | 31.7 | 12.5 | |
| Mistral-7B-Instr.Model Category=Open-source Instructed Models2025.02 | 29.5 | 32.8 | 24.1 | 9.6 | |
| Mistral-7B-Instr.Model Category=Open-source Instructed Models2025.02 | 28.6 | 33 | 25 | 11.5 | |
| Phi-3.5VModel Category=Open-source Instructed Models2025.02 | 23.5 | 28.5 | 20.5 | 2.4 | |
| Phi-3.5VModel Category=Open-source Instructed Models2025.02 | 22.3 | 27 | 21.2 | 1.9 |