Question Answering on HotpotQA (F1)
69.5F1 ScoreOracle
Evaluation results
| Method | Links | |
|---|---|---|
| OracleBackbone=Llama 3.3 70B, Context Length=500 words2026.01 | 69.5 | |
| OracleBackbone=Llama 3.3 70B, Context Length=1500 words2026.01 | 69.5 | |
| OracleBackbone=Qwen 2.5 72B, Context Length=1500 words2026.01 | 68.7 | |
| OracleBackbone=Llama 3.3 70B, Context Length=1000 words2026.01 | 68.6 | |
| OracleBackbone=Qwen 2.5 72B, Context Length=500 words2026.01 | 67.7 | |
| OracleBackbone=Qwen 2.5 72B, Context Length=1000 words2026.01 | 67.5 | |
| DF-RAG + ICBackbone=Qwen 2.5 72B, Context Length=1000 words2026.01 | 62.1 | |
| DF-RAG + ICBackbone=Llama 3.3 70B, Context Length=1500 words2026.01 | 61.8 | |
| DF-RAGBackbone=Qwen 2.5 72B, Context Length=1500 words2026.01 | 61.8 | |
| DF-RAG + ICBackbone=Qwen 2.5 72B, Context Length=1500 words2026.01 | 60.9 | |
| DF-RAGBackbone=Qwen 2.5 72B, Context Length=1000 words2026.01 | 60.4 | |
| DF-RAGBackbone=Llama 3.3 70B, Context Length=1000 words2026.01 | 60.3 | |
| DF-RAG + ICBackbone=Qwen 2.5 72B, Context Length=500 words2026.01 | 60.1 | |
| RAG with gMMRBackbone=Qwen 2.5 72B, Context Length=1500 words2026.01 | 60.1 | |
| DF-RAGBackbone=Llama 3.3 70B, Context Length=1500 words2026.01 | 59.6 | |
| DF-RAGBackbone=Qwen 2.5 72B, Context Length=500 words2026.01 | 58.5 | |
| DF-RAG + ICBackbone=Llama 3.3 70B, Context Length=1000 words2026.01 | 58.4 | |
| DF-RAGBackbone=Llama 3.3 70B, Context Length=500 words2026.01 | 58.1 | |
| RAG with gMMRBackbone=Llama 3.3 70B, Context Length=1500 words2026.01 | 58.1 | |
| Vanilla RAGBackbone=Qwen 2.5 72B, Context Length=1500 words2026.01 | 57.9 | |
| LongRAGBackbone=Qwen 2.5 72B, Context Length=independent2026.01 | 57.7 | |
| LongRAGBackbone=Llama 3.3 70B, Context Length=independent2026.01 | 57.4 | |
| DF-RAG + ICBackbone=Llama 3.3 70B, Context Length=500 words2026.01 | 56.8 | |
| RAG with gMMRBackbone=Qwen 2.5 72B, Context Length=1000 words2026.01 | 56.7 | |
| Vanilla RAGBackbone=Llama 3.3 70B, Context Length=1500 words2026.01 | 56.1 | |
| Vanilla RAGBackbone=Llama 3.3 70B, Context Length=1000 words2026.01 | 56 | |
| RAG with gMMRBackbone=Llama 3.3 70B, Context Length=1000 words2026.01 | 56 | |
| Vanilla RAGBackbone=Qwen 2.5 72B, Context Length=1000 words2026.01 | 55.9 | |
| RAG with gMMRBackbone=Qwen 2.5 72B, Context Length=500 words2026.01 | 55 | |
| RAPTORBackbone=Llama 3.3 70B, Context Length=independent2026.01 | 54.5 | |
| RAG with gMMRBackbone=Llama 3.3 70B, Context Length=500 words2026.01 | 53.3 | |
| RAPTORBackbone=Qwen 2.5 72B, Context Length=independent2026.01 | 53 | |
| Vanilla RAGBackbone=Qwen 2.5 72B, Context Length=500 words2026.01 | 51.2 | |
| Vanilla RAGBackbone=Llama 3.3 70B, Context Length=500 words2026.01 | 51.1 | |
| HippoRAGBackbone=Qwen 2.5 72B, Context Length=independent2026.01 | 47 | |
| HippoRAGBackbone=Llama 3.3 70B, Context Length=independent2026.01 | 46.2 |