Fine-Grained Action Execution on OSExpert-Eval
28GIMP Success RateOSExpert (Explore w/ Qwen-3-VL-8B)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| OSExpert (Explore w/ Qwen-3-VL-8B)Agent Type=Agentic Framework2026.03 | 28 | 26 | |
| OSExpert (Explore w/ GPT-5 & UI-TARS)Agent Type=Agentic Framework2026.03 | 28 | 26 | |
| OSExpert (Explore w/ Qwen-3-VL-8B, wo/ Fine Skills)Agent Type=Agentic Framework2026.03 | 14 | 10 | |
| OpenCUA-7BAgent Type=Specialized Model2026.03 | 7 | 5 | |
| Qwen-3-VL-8BAgent Type=General Model2026.03 | 7 | 10 | |
| Computer-Use-PreviewAgent Type=Specialized Model2026.03 | 0 | 0 | |
| CoAct-1Agent Type=Agentic Framework2026.03 | 0 | 5 | |
| Agent-S3 w/ GPT-5Agent Type=Agentic Framework2026.03 | 0 | 10 |