Multimodal Search on MAT-Search
86AccuracyGemini-3-Pro
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini-3-ProWorkflow=Agentic Model (zero-shot), Model Type=Proprietary2026.06 | 86 | |
| GPT-5Workflow=Agentic Model (zero-shot), Model Type=Proprietary2026.06 | 84.67 | |
| SenseNova-MARSWorkflow=Agentic Model, Model Type=Open-source2026.06 | 83.33 | |
| Gemini-3-FlashWorkflow=Direct Answer, Model Type=Proprietary2026.06 | 82.67 | |
| Qwen3-VL-8B-InstructWorkflow=Agentic Model (zero-shot), Model Type=Open-source2026.06 | 82.67 | |
| Gemini-3-FlashWorkflow=Agentic Model (zero-shot), Model Type=Proprietary2026.06 | 82.67 | |
| TAPOWorkflow=Agentic Model, Model Type=Open-source, Backbone=SAPO2026.06 | 82.67 | |
| Gemini-2.5-FlashWorkflow=Direct Answer, Model Type=Proprietary2026.06 | 82 | |
| Gemini-3-ProWorkflow=Direct Answer, Model Type=Proprietary2026.06 | 82 | |
| Qwen3-VL-32B-InstructWorkflow=Agentic Model (zero-shot), Model Type=Open-source2026.06 | 82 | |
| Qwen3-VL-8B-Instruct+SAPOWorkflow=Agentic Model, Model Type=Open-source2026.06 | 82 | |
| Qwen2.5-VL-32B-InstructWorkflow=Agentic Model (zero-shot), Model Type=Open-source2026.06 | 81.33 | |
| GPT-5.2Workflow=Agentic Model (zero-shot), Model Type=Proprietary2026.06 | 80.67 | |
| GPT-5.2Workflow=Direct Answer, Model Type=Proprietary2026.06 | 80 | |
| GPT-4o-miniWorkflow=Agentic Model (zero-shot), Model Type=Proprietary2026.06 | 80 | |
| GPT-4oWorkflow=Direct Answer, Model Type=Proprietary2026.06 | 79.33 | |
| GPT-5Workflow=Direct Answer, Model Type=Proprietary2026.06 | 79.33 | |
| GPT-4oWorkflow=Agentic Model (zero-shot), Model Type=Proprietary2026.06 | 76.67 | |
| Gemini-2.5-FlashWorkflow=Agentic Model (zero-shot), Model Type=Proprietary2026.06 | 75.33 | |
| Visual-ARFTWorkflow=Agentic Model, Model Type=Open-source2026.06 | 74 | |
| MMSearch-R1Workflow=Agentic Model, Model Type=Open-source2026.06 | 74 | |
| Qwen3-VL-32B-InstructWorkflow=Direct Answer, Model Type=Open-source2026.06 | 72.67 | |
| GPT-4o-miniWorkflow=Direct Answer, Model Type=Proprietary2026.06 | 72.66 | |
| Qwen2.5-VL-32B-InstructWorkflow=Direct Answer, Model Type=Open-source2026.06 | 71.33 | |
| Qwen3-VL-8B-InstructWorkflow=Direct Answer, Model Type=Open-source2026.06 | 67.33 | |
| Qwen2.5-VL-7B-InstructWorkflow=Agentic Model (zero-shot), Model Type=Open-source2026.06 | 67.33 | |
| Qwen2.5-VL-7B-InstructWorkflow=Direct Answer, Model Type=Open-source2026.06 | 60 |