Retrieval on MOAMOB
76.97RecallM3DOCDEP
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| M3DOCDEPRetrievers=Averaged over BGE, E5, BM25, MM-Embed, Top-k=macro-averaged for {1, 2, 3, 4}, RAG Protocol=Shared corpus-level2026.04 | 76.97 | 72.83 | 75.54 | |
| MultiDocFusiontop-k=1 ~ 42026.04 | 67.58 | 61.84 | 65.54 | |
| MultiDocFusionRetrievers=Averaged over BGE, E5, BM25, MM-Embed, Top-k=macro-averaged for {1, 2, 3, 4}, RAG Protocol=Shared corpus-level2026.04 | 67.58 | 61.84 | 65.54 | |
| Length chunkingtop-k=1 ~ 42026.04 | 64.62 | 56.76 | 62.09 | |
| Length chunkingRetrievers=Averaged over BGE, E5, BM25, MM-Embed, Top-k=macro-averaged for {1, 2, 3, 4}, RAG Protocol=Shared corpus-level2026.04 | 64.62 | 56.76 | 62.09 | |
| Perplexity chunkingtop-k=1 ~ 42026.04 | 61.73 | 52.41 | 57.85 | |
| Perplexity chunkingRetrievers=Averaged over BGE, E5, BM25, MM-Embed, Top-k=macro-averaged for {1, 2, 3, 4}, RAG Protocol=Shared corpus-level2026.04 | 61.73 | 52.41 | 57.85 | |
| LumberChunkertop-k=1 ~ 42026.04 | 61.3 | 52.05 | 56.92 | |
| LumberChunkerRetrievers=Averaged over BGE, E5, BM25, MM-Embed, Top-k=macro-averaged for {1, 2, 3, 4}, RAG Protocol=Shared corpus-level2026.04 | 61.3 | 52.05 | 56.92 | |
| Structure-based chunkingtop-k=1 ~ 42026.04 | 55.44 | 46.62 | 51.49 | |
| Structure-based chunkingRetrievers=Averaged over BGE, E5, BM25, MM-Embed, Top-k=macro-averaged for {1, 2, 3, 4}, RAG Protocol=Shared corpus-level2026.04 | 55.44 | 46.62 | 51.49 | |
| Semantic chunkingtop-k=1 ~ 42026.04 | 27.37 | 19.5 | 24.53 | |
| Semantic chunkingRetrievers=Averaged over BGE, E5, BM25, MM-Embed, Top-k=macro-averaged for {1, 2, 3, 4}, RAG Protocol=Shared corpus-level2026.04 | 27.37 | 19.5 | 24.53 |