Web Agent Interaction on RUC suite (test)
60Success Rate (News)w/ DUDE
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| w/ DUDEAgent Base Model=UI-TARS-1.5-7B, Evaluator Model=UI-TARS2026.05 | 60 | 0 | 3.46 | 58 | 2 | 4.44 | 54 | 2 | 3.62 | 60 | 2 | 2.96 | 58 | 1.5 | 3.02 | |
| w/ DUDEAgent Base Model=GLM-4.6V-Flash, Evaluator Model=UI-TARS2026.05 | 60 | 0 | 3.56 | 68 | 2 | 4.22 | 42 | 0 | 5.17 | 72 | 4 | 3.16 | 60.5 | 1.5 | 4.02 | |
| w/ DUDEAgent Base Model=Qwen3-VL-4B, Evaluator Model=UI-TARS2026.05 | 56 | 2 | 2.88 | 74 | 0 | 3.5 | 64 | 0 | 4.42 | 60 | 2 | 4.38 | 63.5 | 0.5 | 3.85 | |
| VanillaAgent Base Model=UI-TARS-1.5-7B2026.05 | 42 | 16 | 18.16 | 36 | 32 | 17.54 | 40 | 24 | 16.56 | 56 | 22 | 11.96 | 43.5 | 23.5 | 16.06 | |
| w/ DUDEAgent Base Model=Qwen3-VL-4B, Evaluator Model=Qwen-2B2026.05 | 20 | 0 | 6.08 | 44 | 0 | 4.96 | 34 | 0 | 6.36 | 36 | 0 | 6.04 | 33.5 | 0 | 5.86 | |
| w/ DUDEAgent Base Model=UI-TARS-1.5-7B, Evaluator Model=Qwen-2B2026.05 | 20 | 0 | 4.82 | 50 | 0 | 4.04 | 38 | 0 | 3.78 | 34 | 0 | 4.06 | 35.5 | 0 | 4.18 | |
| w/ DUDEAgent Base Model=GLM-4.6V-Flash, Evaluator Model=Qwen-2B2026.05 | 20 | 0 | 7.54 | 50 | 4 | 5.43 | 34 | 4 | 6.89 | 42 | 2 | 6.09 | 36.5 | 2.5 | 6.49 | |
| VanillaAgent Base Model=GLM-4.6V-Flash2026.05 | 18 | 2 | 27.24 | 6 | 2 | 28.65 | 12 | 4 | 25.91 | 4 | 8 | 31 | 9.5 | 4 | 28.67 | |
| VanillaAgent Base Model=Qwen3-VL-4B2026.05 | 12 | 4 | 20.58 | 6 | 0 | 25.7 | 6 | 0 | 27.34 | 2 | 4 | 27.3 | 6.5 | 2 | 25.23 |