Question Answering on 2WikiHop (test)
67.1Exact Match (EM)Oracle
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| OracleBackbone=Llama-3.1-8B, Retrieval Infrastructure=Wikipedia corpus, FAISS IVF index, Contriever embeddings2026.05 | 67.1 | 73.4 | 45 | 3.1 | 48 | 24.6 | 4.4 | |
| Ours (Predictive)Backbone=Llama-3.1-8B, Retrieval Infrastructure=Wikipedia corpus, FAISS IVF index, Contriever embeddings2026.05 | 65.9 | 72.1 | 108 | 5.2 | 59 | 14.4 | 7.6 | |
| DRAGINBackbone=Llama-3.1-8B, Retrieval Infrastructure=Wikipedia corpus, FAISS IVF index, Contriever embeddings2026.05 | 65.7 | 71.9 | 178 | 6.4 | 64 | 11.4 | 9.5 | |
| Sync-RAGBackbone=Llama-3.1-8B, Retrieval Infrastructure=Wikipedia corpus, FAISS IVF index, Contriever embeddings2026.05 | 65.4 | 71.8 | 287 | 9.2 | 86 | 8.2 | 13.3 | |
| Adaptive-RAGBackbone=Llama-3.1-8B, Retrieval Infrastructure=Wikipedia corpus, FAISS IVF index, Contriever embeddings2026.05 | 64.8 | 71.2 | 215 | 7.1 | 68 | 10.5 | 10.4 | |
| Self-RAGBackbone=Llama-3.1-8B, Retrieval Infrastructure=Wikipedia corpus, FAISS IVF index, Contriever embeddings2026.05 | 64.2 | 70.5 | 234 | 7.8 | 72 | 9.4 | 11.5 | |
| FLAREBackbone=Llama-3.1-8B, Retrieval Infrastructure=Wikipedia corpus, FAISS IVF index, Contriever embeddings2026.05 | 63.8 | 70.1 | 206 | 6.8 | 71 | 10.6 | 10.3 | |
| PipeRAGBackbone=Llama-3.1-8B, Retrieval Infrastructure=Wikipedia corpus, FAISS IVF index, Contriever embeddings, Retrieval Interval=322026.05 | 63.4 | 69.7 | 118 | 5.6 | 66.8 | 13 | 8.4 | |
| Entropy-ThresholdBackbone=Llama-3.1-8B, Retrieval Infrastructure=Wikipedia corpus, FAISS IVF index, Contriever embeddings2026.05 | 61.3 | 68.2 | 268 | 8.7 | 82 | 8.1 | 13.6 | |
| No-RAGBackbone=Llama-3.1-8B2026.05 | 26.2 | 33.1 | 42 | 2.3 | 0 | 17.1 | 7 |