GUI Navigation on Web-Multi (test)
73.1Type EMQwen-GUI
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Qwen-GUIGUIAct=true2024.06 | 73.1 | 58 | 51.2 | |
| Qwen-GUIGUIAct=true, GUIChat=true2024.06 | 68.9 | 52.5 | 46.8 | |
| Qwen-GUI2024.06 | 68.9 | 52.5 | 46.8 | |
| Fuyu-GUI2024.06 | 68.8 | 51.2 | 47.1 | |
| Fuyu-GUI2024.06 | 68.8 | 51.2 | 47.1 | |
| MiniCPM-GUIGUIAct=true, High Resolution=true2024.06 | 68.2 | 42.4 | 47.1 | |
| MiniCPM-GUIGUIAct=true, Larger LM=true2024.06 | 68.2 | 52.5 | 49.1 | |
| MiniCPM-GUItraining data=GUIAct, configuration=+ High Resolution2024.06 | 68.2 | 42.4 | 47.1 | |
| MiniCPM-GUIGUIAct=true, GUIChat=true2024.06 | 67 | 45.4 | 47.5 | |
| MiniCPM-GUItraining data=GUIAct, configuration=+ GUIChat2024.06 | 67 | 45.4 | 47.5 | |
| MiniCPM-GUIGUIAct=true2024.06 | 62.3 | 42 | 48.6 | |
| MiniCPM-GUItraining data=GUIAct2024.06 | 62.3 | 42 | 48.6 | |
| GPT-4o-mini2024.06 | 22 | 10 | 17 | |
| GPT-4o-minitested samples=100 per dataset2024.06 | 22 | 10 | 17 |