Multimodal Agent Task on AgentVista
23.85Average@4XSkill
Evaluation results
| Method | Links | ||
|---|---|---|---|
| XSkillModel=GPT-5-mini2026.03 | 23.85 | 38.53 | |
| XSkillModel=Gemini-3-Flash2026.03 | 23.39 | 40.37 | |
| XSkillModel=Gemini-2.5-Pro2026.03 | 22.94 | 34.86 | |
| XSkillModel=o4-mini2026.03 | 22.32 | 33.94 | |
| DCModel=Gemini-2.5-Pro2026.03 | 21.79 | 35.78 | |
| Agent-KBModel=Gemini-3-Flash2026.03 | 21.33 | 38.53 | |
| DCModel=GPT-5-mini2026.03 | 21.1 | 36.7 | |
| Agent-KBModel=Gemini-2.5-Pro2026.03 | 20.87 | 33.94 | |
| w/ ToolsModel=Gemini-3-Flash2026.03 | 20.64 | 39.45 | |
| Qwen3.5-35B-A3BEvaluation Protocol=w/ ACE-SKILL2026.05 | 20.64 | 36.7 | |
| w/ ToolsModel=GPT-5-mini2026.03 | 20.41 | 35.78 | |
| GPT-5-miniEvaluation Protocol=Vanilla Tools2026.05 | 20.41 | 35.78 | |
| w/ ToolsModel=Gemini-2.5-Pro2026.03 | 20.18 | 33.94 | |
| DCModel=Gemini-3-Flash2026.03 | 20.18 | 36.7 | |
| Gemini-2.5-ProEvaluation Protocol=Vanilla Tools2026.05 | 20.18 | 33.94 | |
| Agent-KBModel=GPT-5-mini2026.03 | 19.95 | 34.86 | |
| AWMModel=o4-mini2026.03 | 19.95 | 29.36 | |
| AWMModel=Gemini-2.5-Pro2026.03 | 19.72 | 32.11 | |
| AWMModel=Gemini-3-Flash2026.03 | 19.5 | 37.61 | |
| Agent-KBModel=o4-mini2026.03 | 19.5 | 31.19 | |
| AWMModel=GPT-5-mini2026.03 | 19.04 | 34.86 | |
| No ToolsModel=o4-mini2026.03 | 19.04 | 25.69 | |
| o4-miniEvaluation Protocol=Native Direct Answer2026.05 | 19.04 | 25.69 | |
| DCModel=o4-mini2026.03 | 18.81 | 28.44 | |
| No ToolsModel=GPT-5-mini2026.03 | 18.58 | 28.44 | |
| GPT-5-miniEvaluation Protocol=Native Direct Answer2026.05 | 18.58 | 28.44 | |
| No ToolsModel=Gemini-3-Flash2026.03 | 18.35 | 29.36 | |
| Kimi-K2.5Evaluation Protocol=Vanilla Tools2026.05 | 18.35 | 31.19 | |
| w/ ToolsModel=o4-mini2026.03 | 18.12 | 29.36 | |
| o4-miniEvaluation Protocol=Vanilla Tools2026.05 | 18.12 | 29.36 | |
| Kimi-K2.5Evaluation Protocol=Native Direct Answer2026.05 | 18.12 | 30.28 | |
| No ToolsModel=Gemini-2.5-Pro2026.03 | 17.89 | 28.44 | |
| Gemini-2.5-ProEvaluation Protocol=Native Direct Answer2026.05 | 17.89 | 28.44 | |
| Qwen3.5-PlusEvaluation Protocol=Vanilla Tools2026.05 | 16.74 | 31.19 | |
| Qwen3.5-35B-A3BEvaluation Protocol=w/ XSkill2026.05 | 16.51 | 29.36 | |
| GLM-4.6VEvaluation Protocol=Vanilla Tools2026.05 | 15.6 | 31.19 | |
| Qwen3.5-35B-A3BEvaluation Protocol=Vanilla Tools2026.05 | 15.37 | 32.11 | |
| GLM-4.6VEvaluation Protocol=Native Direct Answer2026.05 | 15.14 | 24.77 | |
| Qwen3.5-PlusEvaluation Protocol=Native Direct Answer2026.05 | 11.47 | 18.35 | |
| Qwen3.5-35B-A3BEvaluation Protocol=Native Direct Answer2026.05 | 10.32 | 17.43 |