Visual Reasoning on MMSearch-Plus
32.61Success RateAUTOMMEMO
Evaluation Results
| Method | Links | |
|---|---|---|
| AUTOMMEMOBackbone=Qwen3.5-plus, Execution Model Category=Automatic Design2026.05 | 32.61 | |
| ALMABackbone=Qwen3.5-plus, Execution Model Category=Automatic Design2026.05 | 25.73 | |
| XSkillBackbone=Qwen3.5-plus, Execution Model Category=Multimodal-based2026.05 | 25.21 | |
| TrajectoryRetrievalBackbone=Qwen3.5-plus, Execution Model Category=Text-based2026.05 | 24.99 | |
| NoMemoryBackbone=Qwen3.5-plus, Execution Model Category=None2026.05 | 24.14 | |
| ReasoningBankBackbone=Qwen3.5-plus, Execution Model Category=Text-based2026.05 | 23.08 | |
| G-MemoryBackbone=Qwen3.5-plus, Execution Model Category=Text-based2026.05 | 23 | |
| M2Backbone=Qwen3.5-plus, Execution Model Category=Multimodal-based2026.05 | 18.38 | |
| AUTOMMEMOExecution Model=Qwen3-VL-32B, Memory Schema Category=Automatic Design2026.05 | 11.46 | |
| XSkillExecution Model=Qwen3-VL-32B, Memory Schema Category=Multimodal-based2026.05 | 8.4 | |
| ALMAExecution Model=Qwen3-VL-32B, Memory Schema Category=Automatic Design2026.05 | 7.38 | |
| TrajectoryRetrievalExecution Model=Qwen3-VL-32B, Memory Schema Category=Text-based2026.05 | 7.11 | |
| ReasoningBankExecution Model=Qwen3-VL-32B, Memory Schema Category=Text-based2026.05 | 7.09 | |
| G-MemoryExecution Model=Qwen3-VL-32B, Memory Schema Category=Text-based2026.05 | 6.92 | |
| NoMemoryExecution Model=Qwen3-VL-32B, Memory Schema Category=Baseline2026.05 | 5.77 | |
| AUTOMMEMOExecution Model=GPT-5.4-nano, Memory Schema Category=Automatic Design2026.05 | 5.4 | |
| M2Execution Model=Qwen3-VL-32B, Memory Schema Category=Multimodal-based2026.05 | 4.72 | |
| M2Execution Model=GPT-5.4-nano, Memory Schema Category=Multimodal-based2026.05 | 4.72 | |
| ALMAExecution Model=GPT-5.4-nano, Memory Schema Category=Automatic Design2026.05 | 3.76 | |
| TrajectoryRetrievalExecution Model=GPT-5.4-nano, Memory Schema Category=Text-based2026.05 | 3.68 | |
| ReasoningBankExecution Model=GPT-5.4-nano, Memory Schema Category=Text-based2026.05 | 3.49 | |
| NoMemoryExecution Model=GPT-5.4-nano, Memory Schema Category=Baseline2026.05 | 2.89 | |
| G-MemoryExecution Model=GPT-5.4-nano, Memory Schema Category=Text-based2026.05 | 1.84 | |
| XSkillExecution Model=GPT-5.4-nano, Memory Schema Category=Multimodal-based2026.05 | 1.57 |