Multimodal Classification on CrisisMMD
72.33BC AccuracyMG2-RAG
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| MG2-RAGMethod Category=Graph Retrieval-Augmented Models, LLM/MLLM=Qwen2.5-72B2026.04 | 72.33 | 50.34 | 50.83 | 57.83 | |
| MG2-RAGMethod Category=Graph Retrieval-Augmented Models, LLM/MLLM=GPT-5.22026.04 | 72.3 | 56.1 | 56.7 | 61.7 | |
| MG2-RAGMethod Category=Graph Retrieval-Augmented Models, LLM/MLLM=Qwen3.5-27B2026.04 | 72.28 | 52.3 | 52.79 | 59.12 | |
| Gemini-3.1-ProMethod Category=Zero-Shot Models, LLM/MLLM=Gemini-3.1-Pro2026.04 | 71.3 | 49.36 | 49.79 | 56.82 | |
| MG2-RAGMethod Category=Graph Retrieval-Augmented Models, LLM/MLLM=Qwen2.5-VL-7B2026.04 | 71.03 | 46.45 | 47.25 | 54.91 | |
| GPT-5.2Method Category=Zero-Shot Models, LLM/MLLM=GPT-5.22026.04 | 71 | 53 | 53.6 | 59.2 | |
| Qwen2.5-VL-7BMethod Category=Zero-Shot Models, LLM/MLLM=Qwen2.5-VL-7B2026.04 | 70.45 | 41.44 | 42.33 | 51.41 | |
| Qwen3.5-27BMethod Category=Zero-Shot Models, LLM/MLLM=Qwen3.5-27B2026.04 | 69.83 | 48.82 | 49.35 | 56 | |
| MG2-RAGMethod Category=Graph Retrieval-Augmented Models, LLM/MLLM=Qwen2.5-7B2026.04 | 69.69 | 51.1 | 51.59 | 57.46 | |
| VaLiKMethod Category=Graph Retrieval-Augmented Models, LLM/MLLM=Qwen2.5-7B2026.04 | 68.9 | 50.02 | 50.69 | 56.54 | |
| VaLiKMethod Category=Graph Retrieval-Augmented Models, LLM/MLLM=Qwen2.5-72B2026.04 | 68.89 | 49.78 | 49.31 | 55.99 | |
| MMGraphRAGMethod Category=Graph Retrieval-Augmented Models, LLM/MLLM=Qwen2.5-VL-7B2026.04 | 68.4 | 44.03 | 44.66 | 50.94 | |
| LightRAGMethod Category=Graph Retrieval-Augmented Models, LLM/MLLM=Qwen2.5-7B2026.04 | 67.49 | 45.11 | 45.94 | 52.85 | |
| BLIP-2Method Category=Zero-Shot Models, LLM/MLLM=Flan-T52026.04 | 61.29 | 40.86 | 40.72 | 47.62 | |
| LLaVA-34BMethod Category=Zero-Shot Models, LLM/MLLM=LLaVA-34B2026.04 | 56.44 | 25.15 | 25.07 | 35.55 | |
| CLIP ViT-L/14Method Category=Zero-Shot Models, LLM/MLLM=CLIP ViT-L/142026.04 | 43.36 | 17.88 | 20.79 | 27.34 |