Multimodal Retrieval-Augmented Generation on MRAG
70.8ScorePolarMem
Evaluation results
| Method | Links | |
|---|---|---|
| PolarMemBackbone=QWEN2.5-VL-7B, Augmentation=PolarMem2026.01 | 70.8 | |
| PolarMemBackbone=InternVL-3.5-8B, Augmentation=PolarMem2026.01 | 66.9 | |
| PolarMemBackbone=QWEN2.5-VL-32B, Augmentation=PolarMem2026.01 | 65.4 | |
| ViLoMemBackbone=QWEN2.5-VL-7B, Augmentation=ViLoMem2026.01 | 65.1 | |
| ViLoMemBackbone=QWEN2.5-VL-32B, Augmentation=ViLoMem2026.01 | 64.9 | |
| PolarMemBackbone=InternVL-3.5-4B, Augmentation=PolarMem2026.01 | 64.2 | |
| PolarMemBackbone=DeepSeek-VL2, Augmentation=PolarMem2026.01 | 62.8 | |
| QWEN2.5-VL-32BBackbone=QWEN2.5-VL-32B, Augmentation=None2026.01 | 62.1 | |
| PolarMemBackbone=LLaVA-Next-Llama-3-8B, Augmentation=PolarMem2026.01 | 61.9 | |
| Vanilla RAGBackbone=QWEN2.5-VL-32B, Augmentation=Vanilla RAG2026.01 | 61.4 | |
| ViLoMemBackbone=InternVL-3.5-8B, Augmentation=ViLoMem2026.01 | 61.3 | |
| QWEN2.5-VL-7BBackbone=QWEN2.5-VL-7B, Augmentation=None2026.01 | 60.7 | |
| ViLoMemBackbone=InternVL-3.5-4B, Augmentation=ViLoMem2026.01 | 60.4 | |
| Vanilla RAGBackbone=QWEN2.5-VL-7B, Augmentation=Vanilla RAG2026.01 | 58.9 | |
| ViLoMemBackbone=DeepSeek-VL2, Augmentation=ViLoMem2026.01 | 58.6 | |
| InternVL-3.5-8BBackbone=InternVL-3.5-8B, Augmentation=None2026.01 | 58.5 | |
| Vanilla RAGBackbone=InternVL-3.5-8B, Augmentation=Vanilla RAG2026.01 | 58 | |
| Vanilla RAGBackbone=InternVL-3.5-4B, Augmentation=Vanilla RAG2026.01 | 57 | |
| InternVL-3.5-4BBackbone=InternVL-3.5-4B, Augmentation=None2026.01 | 56.8 | |
| PolarMemBackbone=DeepSeek-VL2-Small, Augmentation=PolarMem2026.01 | 55.9 | |
| Vanilla RAGBackbone=DeepSeek-VL2, Augmentation=Vanilla RAG2026.01 | 55.7 | |
| ViLoMemBackbone=LLaVA-Next-Llama-3-8B, Augmentation=ViLoMem2026.01 | 55.6 | |
| DeepSeek-VL2Backbone=DeepSeek-VL2, Augmentation=None2026.01 | 54.9 | |
| ImageRAGRetrieval Modality=Image, Generator=Qwen3-VL-8B-Instruct2025.04 | 52.55 | |
| UniversalRAG (Qwen3-VL-2B-Instruct)Router Type=Trained, Router Model=Qwen3-VL-2B-Instruct, Generator=Qwen3-VL-8B-Instruct2025.04 | 52.55 | |
| OracleRetrieval Type=Oracle, Generator=Qwen3-VL-8B-Instruct2025.04 | 52.55 | |
| ViLoMemBackbone=DeepSeek-VL2-Small, Augmentation=ViLoMem2026.01 | 52.3 | |
| Vanilla RAGBackbone=LLaVA-Next-Llama-3-8B, Augmentation=Vanilla RAG2026.01 | 52 | |
| LLaVA-Next-Llama-3-8BBackbone=LLaVA-Next-Llama-3-8B, Augmentation=None2026.01 | 51.5 | |
| DeepSeek-VL2-SmallBackbone=DeepSeek-VL2-Small, Augmentation=None2026.01 | 48.2 | |
| Vanilla RAGBackbone=DeepSeek-VL2-Small, Augmentation=Vanilla RAG2026.01 | 48 | |
| PolarMemBackbone=LLaVA-Next-Mistral-7B, Augmentation=PolarMem2026.01 | 41 | |
| ViLoMemBackbone=LLaVA-Next-Mistral-7B, Augmentation=ViLoMem2026.01 | 36.9 | |
| Vanilla RAGBackbone=LLaVA-Next-Mistral-7B, Augmentation=Vanilla RAG2026.01 | 24.3 | |
| LLaVA-Next-Mistral-7BBackbone=LLaVA-Next-Mistral-7B, Augmentation=None2026.01 | 23.5 |