Visual Reasoning on AgentVista
28.81Success RateAUTOMMEMO
Evaluation Results
| Method | Links | |
|---|---|---|
| AUTOMMEMOBackbone=Qwen3.5-plus, Execution Model Category=Automatic Design2026.05 | 28.81 | |
| ALMABackbone=Qwen3.5-plus, Execution Model Category=Automatic Design2026.05 | 23.44 | |
| XSkillBackbone=Qwen3.5-plus, Execution Model Category=Multimodal-based2026.05 | 21.75 | |
| TrajectoryRetrievalBackbone=Qwen3.5-plus, Execution Model Category=Text-based2026.05 | 20.03 | |
| NoMemoryBackbone=Qwen3.5-plus, Execution Model Category=None2026.05 | 17.87 | |
| G-MemoryBackbone=Qwen3.5-plus, Execution Model Category=Text-based2026.05 | 17.33 | |
| AUTOMMEMOExecution Model=Qwen3-VL-32B, Memory Schema Category=Automatic Design2026.05 | 14.36 | |
| ReasoningBankBackbone=Qwen3.5-plus, Execution Model Category=Text-based2026.05 | 11.7 | |
| XSkillExecution Model=Qwen3-VL-32B, Memory Schema Category=Multimodal-based2026.05 | 11.43 | |
| ALMAExecution Model=Qwen3-VL-32B, Memory Schema Category=Automatic Design2026.05 | 11.12 | |
| AUTOMMEMOExecution Model=GPT-5.4-nano, Memory Schema Category=Automatic Design2026.05 | 10.95 | |
| NoMemoryExecution Model=Qwen3-VL-32B, Memory Schema Category=Baseline2026.05 | 10.86 | |
| M2Backbone=Qwen3.5-plus, Execution Model Category=Multimodal-based2026.05 | 10.52 | |
| M2Execution Model=Qwen3-VL-32B, Memory Schema Category=Multimodal-based2026.05 | 10.47 | |
| TrajectoryRetrievalExecution Model=Qwen3-VL-32B, Memory Schema Category=Text-based2026.05 | 10.24 | |
| G-MemoryExecution Model=Qwen3-VL-32B, Memory Schema Category=Text-based2026.05 | 9.72 | |
| M2Execution Model=GPT-5.4-nano, Memory Schema Category=Multimodal-based2026.05 | 9.47 | |
| TrajectoryRetrievalExecution Model=GPT-5.4-nano, Memory Schema Category=Text-based2026.05 | 9.41 | |
| ALMAExecution Model=GPT-5.4-nano, Memory Schema Category=Automatic Design2026.05 | 9.13 | |
| ReasoningBankExecution Model=Qwen3-VL-32B, Memory Schema Category=Text-based2026.05 | 9.05 | |
| NoMemoryExecution Model=GPT-5.4-nano, Memory Schema Category=Baseline2026.05 | 8.37 | |
| ReasoningBankExecution Model=GPT-5.4-nano, Memory Schema Category=Text-based2026.05 | 7.84 | |
| G-MemoryExecution Model=GPT-5.4-nano, Memory Schema Category=Text-based2026.05 | 7.62 | |
| XSkillExecution Model=GPT-5.4-nano, Memory Schema Category=Multimodal-based2026.05 | 5.92 |