Multimodal Retrieval-Augmented Generation on FACET
92.58AccuracyMS-PoE + BAIR
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| MS-PoE + BAIRModel=Qwen2.5-VL-3B2026.05 | 92.58 | 70.71 | 3.53 | 20.03 | 68.79 | 76.96 | 65.4 | 0.63 | |
| MS-PoE + BAIRModel=DeepSeek-VL-7B2026.05 | 91.94 | 51.58 | 3.7 | 13.94 | 51.97 | 72.84 | 44.58 | 0 | |
| MS-PoEModel=DeepSeek-VL-7B2026.05 | 91.82 | 51.05 | 3.78 | 13.51 | 51.07 | 72.41 | 43.51 | 0.03 | |
| Standard RAG + BAIRModel=DeepSeek-VL-7B2026.05 | 91.02 | 30.95 | 2.48 | 12.48 | 11.61 | 23.71 | 7.33 | 0 | |
| MAD-RAG + BAIRModel=DeepSeek-VL-7B2026.05 | 90.96 | 31.68 | 2.63 | 12.05 | 14.54 | 31.47 | 8.55 | 0 | |
| Standard RAGModel=DeepSeek-VL-7B2026.05 | 90.89 | 31.05 | 2.64 | 11.76 | — | — | — | 0 | |
| MAD-RAGModel=DeepSeek-VL-7B2026.05 | 90.86 | 30.84 | 2.65 | 11.64 | 12.4 | 25.86 | 7.63 | — | |
| Visual-focus Instr. + BAIRModel=DeepSeek-VL-7B2026.05 | 90.81 | 30.84 | 2.71 | 11.38 | 10.6 | 21.55 | 6.72 | 0 | |
| Visual-focus Instr.Model=DeepSeek-VL-7B2026.05 | 90.47 | 28.53 | 2.83 | 10.08 | 7.67 | 17.67 | 4.12 | 0 | |
| BaselineModel=DeepSeek-VL-7B2026.05 | 90.24 | — | — | — | — | — | — | 0 | |
| Standard RAG + BAIRModel=Qwen2.5-VL-3B2026.05 | 88.56 | 50.31 | 4.64 | 10.84 | 43.28 | 54.81 | 38.5 | 0.02 | |
| LongLLMLingua + BAIRModel=DeepSeek-VL-7B2026.05 | 87.8 | 33.79 | 6.36 | 5.31 | 29.76 | 43.1 | 25.04 | — | |
| LongLLMLinguaModel=DeepSeek-VL-7B2026.05 | 87.76 | 34.21 | 6.45 | 5.3 | 29.54 | 41.81 | 25.19 | 0 | |
| LongLLMLingua + BAIRModel=Qwen2.5-VL-3B2026.05 | 87.45 | 45.97 | 4.89 | 9.4 | 42.09 | 62.22 | 34.07 | 0.05 | |
| Visual-focus Instr. + BAIRModel=Qwen2.5-VL-3B2026.05 | 87.28 | 44.93 | 5.2 | 8.64 | 38.82 | 54.14 | 32.47 | 0.04 | |
| MAD-RAG + BAIRModel=Qwen2.5-VL-3B2026.05 | 85.1 | 36.08 | 6.19 | 5.83 | 27.41 | 42.09 | 21.34 | 0 | |
| BaselineModel=Qwen2.5-VL-3B2026.05 | 84.91 | — | — | — | — | — | — | 0 | |
| MAD-RAGModel=Qwen2.5-VL-3B2026.05 | 84.41 | 25.53 | 5.11 | 5 | 13.86 | 31.22 | 6.71 | 0 | |
| Visual-focus Instr.Model=Qwen2.5-VL-3B2026.05 | 84.38 | 28.25 | 5.65 | 5 | 16.59 | 31.54 | 10.39 | 0 | |
| LongLLMLinguaModel=Qwen2.5-VL-3B2026.05 | 84.36 | 31.59 | 6.26 | 5.05 | 25.25 | 44.97 | 17.07 | 0 | |
| Standard RAGModel=Qwen2.5-VL-3B2026.05 | 84.34 | 26.62 | 5.41 | 4.92 | — | — | — | 0 | |
| MS-PoEModel=Qwen2.5-VL-3B2026.05 | 82 | 29.07 | 8.6 | 3.38 | 20.07 | 37.14 | 12.99 | 2.24 |