Question Answering on DUDE
21.43ANLSM3DOCDEP
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| M3DOCDEPtop-k={1, 2, 3, 4}, Readers=LLaVA-OneVision-1.5, InternVL-3.5, and Qwen2.5-VL, RAG protocol=shared corpus-level RAG protocol2026.04 | 21.43 | 18.21 | 25.12 | |
| MultiDocFusiontop-k={1, 4}, Models=Llama-3.2-3B, Mistral-8B, Qwen-2.5-7B (averaged)2026.04 | 18.59 | 16.92 | 22.85 | |
| MultiDocFusiontop-k={1, 2, 3, 4}, Readers=LLaVA-OneVision-1.5, InternVL-3.5, and Qwen2.5-VL, RAG protocol=shared corpus-level RAG protocol2026.04 | 18.59 | 16.92 | 22.85 | |
| Structure-based chunkingtop-k={1, 4}, Models=Llama-3.2-3B, Mistral-8B, Qwen-2.5-7B (averaged)2026.04 | 17.51 | 14.89 | 19.21 | |
| Structure-based chunkingtop-k={1, 2, 3, 4}, Readers=LLaVA-OneVision-1.5, InternVL-3.5, and Qwen2.5-VL, RAG protocol=shared corpus-level RAG protocol2026.04 | 17.51 | 14.89 | 19.21 | |
| Perplexity chunkingtop-k={1, 4}, Models=Llama-3.2-3B, Mistral-8B, Qwen-2.5-7B (averaged)2026.04 | 16.53 | 13.9 | 18.55 | |
| Perplexity chunkingtop-k={1, 2, 3, 4}, Readers=LLaVA-OneVision-1.5, InternVL-3.5, and Qwen2.5-VL, RAG protocol=shared corpus-level RAG protocol2026.04 | 16.53 | 13.9 | 18.55 | |
| Length chunkingtop-k={1, 4}, Models=Llama-3.2-3B, Mistral-8B, Qwen-2.5-7B (averaged)2026.04 | 16.11 | 14.44 | 19.88 | |
| Length chunkingtop-k={1, 2, 3, 4}, Readers=LLaVA-OneVision-1.5, InternVL-3.5, and Qwen2.5-VL, RAG protocol=shared corpus-level RAG protocol2026.04 | 16.11 | 14.44 | 19.88 | |
| Semantic chunkingtop-k={1, 4}, Models=Llama-3.2-3B, Mistral-8B, Qwen-2.5-7B (averaged)2026.04 | 15.48 | 12.61 | 16.57 | |
| Semantic chunkingtop-k={1, 2, 3, 4}, Readers=LLaVA-OneVision-1.5, InternVL-3.5, and Qwen2.5-VL, RAG protocol=shared corpus-level RAG protocol2026.04 | 15.48 | 12.61 | 16.57 | |
| LumberChunkertop-k={1, 4}, Models=Llama-3.2-3B, Mistral-8B, Qwen-2.5-7B (averaged)2026.04 | 15.31 | 12.84 | 17.52 | |
| LumberChunkertop-k={1, 2, 3, 4}, Readers=LLaVA-OneVision-1.5, InternVL-3.5, and Qwen2.5-VL, RAG protocol=shared corpus-level RAG protocol2026.04 | 15.31 | 12.84 | 17.52 |