End-to-End Question Answering on MultiHop-RAG 3-hop
48.38Exact MatchScalDPP
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ScalDPPReranker=BAAI/bge-reranker-v2-m3, Context Budget (K)=10, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 48.38 | 48.38 | 48.38 | |
| DPP Base, w/o P-AdapterReranker=None, Context Budget (K)=10, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 48.05 | 48.05 | 48.05 | |
| DPP Base, w/o P-AdapterReranker=BAAI/bge-reranker-v2-m3, Context Budget (K)=10, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 47.4 | 47.62 | 47.4 | |
| ScalDPPReranker=None, Context Budget (K)=10, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 47.4 | 47.75 | 48.05 | |
| Standard RAGReranker=None, Context Budget (K)=10, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 43.83 | 44.05 | 43.83 | |
| Standard RAGReranker=BAAI/bge-reranker-v2-m3, Context Budget (K)=10, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 43.83 | 44.05 | 44.16 | |
| ScalDPPReranker=BAAI/bge-reranker-v2-m3, Context Budget (K)=4, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 41.23 | 41.52 | 41.56 | |
| ScalDPPReranker=None, Context Budget (K)=4, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 40.26 | 40.69 | 40.26 | |
| DPP Base, w/o P-AdapterReranker=None, Context Budget (K)=4, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 38.31 | 38.53 | 38.31 | |
| DPP Base, w/o P-AdapterReranker=BAAI/bge-reranker-v2-m3, Context Budget (K)=4, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 38.31 | 38.74 | 38.64 | |
| Standard RAGReranker=BAAI/bge-reranker-v2-m3, Context Budget (K)=4, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 37.01 | 37.23 | 37.01 | |
| Standard RAGReranker=None, Context Budget (K)=4, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 36.04 | 36.11 | 36.36 |