GUI Automation on WorldGUI Meta 1.0
88.9Success Rate (Office)Human*
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Human*2025.02 | 88.9 | 100 | 95.2 | 81.8 | 90 | 85.3 | |
| WorldGUI-AgentBackbone Model=GPT-5.1, Framework=WorldGUI-Agent2025.02 | 64.4 | 62.5 | 85.7 | 63.6 | 60 | 45.8 | |
| WorldGUI-AgentBackbone Model=Claude-3.5-Sonnet, Framework=WorldGUI-Agent2025.02 | 57.8 | 50 | 76.2 | 54.6 | 50 | 36 | |
| WorldGUI-AgentBackbone Model=GPT-4o, Framework=WorldGUI-Agent2025.02 | 42.2 | 41.7 | 47.6 | 45.5 | 40 | 26 | |
| Agent S22025.02 | 33.3 | 70.8 | 52.4 | 45.5 | 20 | 34.2 | |
| WorldGUI-AgentBackbone Model=Gemini-2.0, Framework=WorldGUI-Agent2025.02 | 31.1 | 20.8 | 38.1 | 36.4 | 20 | 19.1 | |
| CCUBackbone Model=Claude-3.5-Sonnet, Framework=CCU2025.02 | 28.9 | 29.2 | 71.4 | 54.6 | 30 | 23.6 | |
| UI-TARS-1.5Backbone Model=UI-TARS-1.52025.02 | 28.9 | 12.5 | 28.6 | 36.7 | 0 | 12.3 | |
| AssistGUIBackbone Model=GPT-4o, Framework=AssistGUI2025.02 | 26.7 | 29.2 | 33.3 | 27.3 | 10 | 16.5 | |
| Plan-ActBackbone Model=GPT-4o, Framework=Plan-Act2025.02 | 13.3 | 8.3 | 23.8 | 9.1 | 10 | 8.5 | |
| Plan-ActBackbone Model=Gemini-2.0, Framework=Plan-Act2025.02 | 8.9 | 8.3 | 28.6 | 18.2 | 10 | 6.9 |