Computer Use on AgentHijack (test)
27.8Clean RateAgentHijack-Agent
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AgentHijack-AgentBase Model=UI-TARS-1.5-7B2026.05 | 27.8 | 21.51 | 12.53 | 27.28 | 26.45 | 21.17 | 24.37 | 24.51 | 23.09 | 20.15 | 22.89 | |
| UI-TARS-1.5-7BModel Type=State-of-the-Art GUI Agent2026.05 | 24.21 | 10.28 | 11.69 | 23.31 | 22.75 | 19.25 | 22.54 | 20.84 | 22.02 | 10.48 | 18.74 | |
| UI-TARS-72B-DPOModel Type=State-of-the-Art GUI Agent2026.05 | 22.38 | 15.51 | 14.32 | 20.36 | 19.32 | 18.94 | 14.44 | 15.19 | 19.76 | 9.42 | 16.96 | |
| UI-TARS-7B-DPOModel Type=State-of-the-Art GUI Agent2026.05 | 16.2 | 13.09 | 10.03 | 13.41 | 15.59 | 13.85 | 13.97 | 13.61 | 13.33 | 8.31 | 13.14 | |
| Qwen2.5-VL-72B-InstructModel Type=Open-source Multimodal Large Language Model2026.05 | 10.99 | 1.86 | 6.38 | 9.45 | 10.29 | 5.79 | 7.48 | 8.32 | 7.48 | 6.63 | 7.47 | |
| Gemini-2.5-ProModel Type=Closed-source Multimodal Large Language Model2026.05 | 8.11 | 5.2 | 6.98 | 6.64 | 6.28 | 2.76 | 4.61 | 2.78 | 7.02 | 7.81 | 5.82 | |
| GPT-4oModel Type=Closed-source Multimodal Large Language Model2026.05 | 5.38 | 1.44 | 4.82 | 2.56 | 3.66 | 3.68 | 3.12 | 4.82 | 4.24 | 3.25 | 3.69 | |
| GLM-4.5VModel Type=Open-source Multimodal Large Language Model2026.05 | 4.24 | 0.86 | 3.68 | 2.52 | 3.68 | 3.68 | 1.98 | 4.24 | 2.52 | 3.12 | 3.05 | |
| Claude-3.7-SonnetModel Type=Closed-source Multimodal Large Language Model2026.05 | 4.23 | 1.41 | 2.54 | 2.82 | 2.54 | 1.97 | 2.54 | 2.25 | 1.69 | 2.54 | 2.45 | |
| Llama-3.2-90B-Vision-InstructModel Type=Open-source Multimodal Large Language Model2026.05 | 3.97 | 0.77 | 1.64 | 1.93 | 1.87 | 1.59 | 1.45 | 0 | 1.45 | 1.64 | 1.63 |