Multimodal Retrieval-Augmented Generation on MRAMG
35ScorePolarMem
Evaluation Results
| Method | Links | |
|---|---|---|
| PolarMemBackbone=InternVL-3.5-8B, Augmentation=PolarMem2026.01 | 35 | |
| PolarMemBackbone=InternVL-3.5-4B, Augmentation=PolarMem2026.01 | 33.7 | |
| PolarMemBackbone=QWEN2.5-VL-32B, Augmentation=PolarMem2026.01 | 32 | |
| ViLoMemBackbone=InternVL-3.5-8B, Augmentation=ViLoMem2026.01 | 32 | |
| ViLoMemBackbone=QWEN2.5-VL-32B, Augmentation=ViLoMem2026.01 | 31.2 | |
| PolarMemBackbone=LLaVA-Next-Llama-3-8B, Augmentation=PolarMem2026.01 | 31.2 | |
| InternVL-3.5-8BBackbone=InternVL-3.5-8B, Augmentation=None2026.01 | 30.2 | |
| ViLoMemBackbone=InternVL-3.5-4B, Augmentation=ViLoMem2026.01 | 30 | |
| Vanilla RAGBackbone=InternVL-3.5-8B, Augmentation=Vanilla RAG2026.01 | 29.4 | |
| Vanilla RAGBackbone=QWEN2.5-VL-32B, Augmentation=Vanilla RAG2026.01 | 29 | |
| ViLoMemBackbone=LLaVA-Next-Llama-3-8B, Augmentation=ViLoMem2026.01 | 29 | |
| QWEN2.5-VL-32BBackbone=QWEN2.5-VL-32B, Augmentation=None2026.01 | 28.5 | |
| InternVL-3.5-4BBackbone=InternVL-3.5-4B, Augmentation=None2026.01 | 28.4 | |
| PolarMemBackbone=QWEN2.5-VL-7B, Augmentation=PolarMem2026.01 | 27.9 | |
| Vanilla RAGBackbone=InternVL-3.5-4B, Augmentation=Vanilla RAG2026.01 | 27.2 | |
| QWEN2.5-VL-7BBackbone=QWEN2.5-VL-7B, Augmentation=None2026.01 | 26.7 | |
| PolarMemBackbone=DeepSeek-VL2-Small, Augmentation=PolarMem2026.01 | 26.7 | |
| PolarMemBackbone=DeepSeek-VL2, Augmentation=PolarMem2026.01 | 26.1 | |
| ViLoMemBackbone=QWEN2.5-VL-7B, Augmentation=ViLoMem2026.01 | 25.6 | |
| LLaVA-Next-Llama-3-8BBackbone=LLaVA-Next-Llama-3-8B, Augmentation=None2026.01 | 25.1 | |
| Vanilla RAGBackbone=LLaVA-Next-Llama-3-8B, Augmentation=Vanilla RAG2026.01 | 24.6 | |
| ViLoMemBackbone=DeepSeek-VL2, Augmentation=ViLoMem2026.01 | 24.4 | |
| ViLoMemBackbone=DeepSeek-VL2-Small, Augmentation=ViLoMem2026.01 | 23.8 | |
| Vanilla RAGBackbone=DeepSeek-VL2-Small, Augmentation=Vanilla RAG2026.01 | 22.4 | |
| PolarMemBackbone=LLaVA-Next-Mistral-7B, Augmentation=PolarMem2026.01 | 22.4 | |
| Vanilla RAGBackbone=QWEN2.5-VL-7B, Augmentation=Vanilla RAG2026.01 | 22.1 | |
| Vanilla RAGBackbone=DeepSeek-VL2, Augmentation=Vanilla RAG2026.01 | 22 | |
| DeepSeek-VL2Backbone=DeepSeek-VL2, Augmentation=None2026.01 | 21.8 | |
| DeepSeek-VL2-SmallBackbone=DeepSeek-VL2-Small, Augmentation=None2026.01 | 21.5 | |
| ViLoMemBackbone=LLaVA-Next-Mistral-7B, Augmentation=ViLoMem2026.01 | 19.1 | |
| Vanilla RAGBackbone=LLaVA-Next-Mistral-7B, Augmentation=Vanilla RAG2026.01 | 17.2 | |
| LLaVA-Next-Mistral-7BBackbone=LLaVA-Next-Mistral-7B, Augmentation=None2026.01 | 16.5 |