GUI Navigation on Mind2Web (Cross-Website)
44.6Element AccuracyDuSAR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DuSARModel=Llama3.1-70B2025.12 | 44.6 | 32.3 | |
| DuSARModel=Gemma3-12B2025.12 | 37.9 | 29.6 | |
| DuSARModel=Llama3.1-8B2025.12 | 37.8 | 25.4 | |
| TRADModel=Llama3.1-70B2025.12 | 36 | 29 | |
| SynapseModel=Llama3.1-70B2025.12 | 29.4 | 19 | |
| TRADModel=Gemma3-12B2025.12 | 28.2 | 23 | |
| SynapseModel=Gemma3-12B2025.12 | 27.3 | 20.7 | |
| SeeClick2024.06 | 21.4 | 16.4 | |
| MiniCPM-GUI2024.06 | 20.3 | 17.3 | |
| ReActModel=Gemma3-12B2025.12 | 20.1 | 14 | |
| Qwen-GUI2024.06 | 19.3 | 15.6 | |
| SynapseModel=Llama3.1-8B2025.12 | 18.2 | 6.7 | |
| Qwen-VL2024.06 | 16.8 | 14 | |
| TRADModel=Llama3.1-8B2025.12 | 15.1 | 9.7 | |
| Fuyu-GUI2024.06 | 13.9 | 12.2 | |
| DuSARModel=Llama2-7B2025.12 | 12.8 | 6.6 | |
| SynapseModel=Llama2-7B2025.12 | 12 | 9.5 | |
| ReActModel=Llama3.1-70B2025.12 | 10.7 | 8.5 | |
| TRADModel=Llama2-7B2025.12 | 9.9 | 7.6 | |
| MiniCPM-V2024.06 | 8.2 | 6 | |
| ReActModel=Llama2-7B2025.12 | 8.1 | 6.6 | |
| ReActModel=Llama3.1-8B2025.12 | 6.2 | 3.1 | |
| Fuyu-8BBackbone=Fuyu-8B2024.06 | 4.8 | 4 |