GUI Navigation on Smartphone (test)
76.1Type EMMiniCPM-GUI
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MiniCPM-GUIGUIAct=true, Larger LM=true2024.06 | 76.1 | 49.9 | 52.8 | |
| Qwen-GUIGUIAct=true2024.06 | 74.7 | 56.8 | 60.8 | |
| Qwen-GUIGUIAct=true, GUIChat=true2024.06 | 73 | 55.7 | 58.1 | |
| Qwen-GUI2024.06 | 73 | 55.7 | 58.1 | |
| MiniCPM-GUIGUIAct=true, High Resolution=true2024.06 | 72.6 | 47.5 | 52 | |
| MiniCPM-GUItraining data=GUIAct, configuration=+ High Resolution2024.06 | 72.6 | 47.5 | 52 | |
| Fuyu-GUI2024.06 | 72.1 | 29.1 | 40.4 | |
| Fuyu-GUI2024.06 | 72.1 | 29.1 | 40.4 | |
| MiniCPM-GUIGUIAct=true, GUIChat=true2024.06 | 71.7 | 44.7 | 53.3 | |
| MiniCPM-GUItraining data=GUIAct, configuration=+ GUIChat2024.06 | 71.7 | 44.7 | 53.3 | |
| MiniCPM-GUIGUIAct=true2024.06 | 64.5 | 29.6 | 43.3 | |
| MiniCPM-GUItraining data=GUIAct2024.06 | 64.5 | 29.6 | 43.3 | |
| GPT-4o-mini2024.06 | 53 | 13 | 22 | |
| GPT-4o-minitested samples=100 per dataset2024.06 | 53 | 13 | 22 |