Question Answering on HotpotQA (test) (EM, F1, TTFT, E2E, Ret/1K, Eff., QAL Metrics)
70.3EMOracle
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| OracleBackbone=Llama-3.1-8B, Retrieval Infrastructure=Wikipedia corpus, FAISS IVF index, Contriever embeddings2026.05 | 70.3 | 76.2 | 45 | 3.1 | 48 | 24.6 | 4.4 | |
| Sync-RAGBackbone=Llama-3.1-8B, Retrieval Infrastructure=Wikipedia corpus, FAISS IVF index, Contriever embeddings2026.05 | 69.2 | 75.1 | 287 | 9.2 | 86 | 8.2 | 13.3 | |
| Ours (Predictive)Backbone=Llama-3.1-8B, Retrieval Infrastructure=Wikipedia corpus, FAISS IVF index, Contriever embeddings2026.05 | 68.7 | 75.1 | 108 | 5.2 | 59 | 14.4 | 7.6 | |
| Adaptive-RAGBackbone=Llama-3.1-8B, Retrieval Infrastructure=Wikipedia corpus, FAISS IVF index, Contriever embeddings2026.05 | 68.5 | 74.3 | 215 | 7.1 | 68 | 10.5 | 10.4 | |
| Self-RAGBackbone=Llama-3.1-8B, Retrieval Infrastructure=Wikipedia corpus, FAISS IVF index, Contriever embeddings2026.05 | 67.8 | 73.6 | 234 | 7.8 | 72 | 9.4 | 11.5 | |
| DRAGINBackbone=Llama-3.1-8B, Retrieval Infrastructure=Wikipedia corpus, FAISS IVF index, Contriever embeddings2026.05 | 67.3 | 73.2 | 178 | 6.4 | 64 | 11.4 | 9.5 | |
| PipeRAGBackbone=Llama-3.1-8B, Retrieval Infrastructure=Wikipedia corpus, FAISS IVF index, Contriever embeddings, Retrieval Interval=322026.05 | 66.8 | 72.9 | 118 | 5.6 | 66.8 | 13 | 8.4 | |
| FLAREBackbone=Llama-3.1-8B, Retrieval Infrastructure=Wikipedia corpus, FAISS IVF index, Contriever embeddings2026.05 | 65.9 | 72.1 | 206 | 6.8 | 71 | 10.6 | 10.3 | |
| Entropy-ThresholdBackbone=Llama-3.1-8B, Retrieval Infrastructure=Wikipedia corpus, FAISS IVF index, Contriever embeddings2026.05 | 64.2 | 70.5 | 268 | 8.7 | 82 | 8.1 | 13.6 | |
| No-RAGBackbone=Llama-3.1-8B2026.05 | 32.8 | 39.4 | 42 | 2.3 | 0 | 17.1 | 7 |