End-to-End Question Answering on MultiHop-RAG (overall)
50.61Exact MatchDPP Base, w/o P-Adapter
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DPP Base, w/o P-AdapterReranker=BAAI/bge-reranker-v2-m3, Context Budget (K)=10, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 50.61 | 51.04 | 51.4 | |
| ScalDPPReranker=BAAI/bge-reranker-v2-m3, Context Budget (K)=10, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 49.5 | 49.82 | 50.06 | |
| ScalDPPReranker=None, Context Budget (K)=10, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 48.6 | 48.8 | 49.16 | |
| Standard RAGReranker=BAAI/bge-reranker-v2-m3, Context Budget (K)=10, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 48.49 | 48.89 | 48.94 | |
| Standard RAGReranker=None, Context Budget (K)=10, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 45.92 | 46.27 | 46.59 | |
| DPP Base, w/o P-AdapterReranker=None, Context Budget (K)=10, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 44.8 | 44.93 | 45.03 | |
| ScalDPPReranker=BAAI/bge-reranker-v2-m3, Context Budget (K)=4, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 44.47 | 44.8 | 44.92 | |
| DPP Base, w/o P-AdapterReranker=BAAI/bge-reranker-v2-m3, Context Budget (K)=4, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 44.02 | 44.5 | 44.36 | |
| Standard RAGReranker=BAAI/bge-reranker-v2-m3, Context Budget (K)=4, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 42.01 | 42.4 | 42.12 | |
| ScalDPPReranker=None, Context Budget (K)=4, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 38.99 | 39.4 | 39.33 | |
| Standard RAGReranker=None, Context Budget (K)=4, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 36.87 | 37.16 | 37.21 | |
| DPP Base, w/o P-AdapterReranker=None, Context Budget (K)=4, Retrieval Model (Embedding)=BAAI/bge-m3, Generator=DeepSeek-V3.22026.02 | 33.74 | 33.82 | 33.74 |