Question Answering on En.QA
47.8F1Oracle
Evaluation results
| Method | Links | ||
|---|---|---|---|
| OracleBackbone=Llama 3.3 70B, Context Length=1500 words2026.01 | 47.8 | — | |
| OracleBackbone=Qwen 2.5 72B, Context Length=1500 words2026.01 | 47.4 | — | |
| OracleBackbone=Llama 3.3 70B, Context Length=1000 words2026.01 | 45.2 | — | |
| OracleBackbone=Qwen 2.5 72B, Context Length=1000 words2026.01 | 44.1 | — | |
| OracleBackbone=Llama 3.3 70B, Context Length=500 words2026.01 | 41.3 | — | |
| OracleBackbone=Qwen 2.5 72B, Context Length=500 words2026.01 | 40.1 | — | |
| DocTrace (w/o DM)Category=Ours2026.06 | 37.19 | 22.79 | |
| DocTraceCategory=Ours2026.06 | 37.18 | 24.22 | |
| ComoRAGCategory=Hybrid Structured RAG2026.06 | 34.52 | 25.07 | |
| Naive RAGCategory=Flat RAG2026.06 | 34.34 | 24.57 | |
| DF-RAGBackbone=Qwen 2.5 72B, Context Length=1500 words2026.01 | 34 | — | |
| RAG with gMMRBackbone=Llama 3.3 70B, Context Length=1500 words2026.01 | 33.2 | — | |
| DF-RAG + ICBackbone=Qwen 2.5 72B, Context Length=1500 words2026.01 | 33.2 | — | |
| Vanilla RAGBackbone=Llama 3.3 70B, Context Length=1500 words2026.01 | 33.1 | — | |
| DF-RAGBackbone=Llama 3.3 70B, Context Length=1500 words2026.01 | 33.1 | — | |
| RAG with gMMRBackbone=Qwen 2.5 72B, Context Length=1500 words2026.01 | 32.5 | — | |
| RAPTOR+IRCoTCategory=Summary-based RAG2026.06 | 32.09 | 19.36 | |
| DF-RAG + ICBackbone=Llama 3.3 70B, Context Length=1500 words2026.01 | 31.8 | — | |
| DF-RAGBackbone=Llama 3.3 70B, Context Length=1000 words2026.01 | 31.5 | — | |
| Vanilla RAGBackbone=Qwen 2.5 72B, Context Length=1500 words2026.01 | 31.3 | — | |
| DF-RAGBackbone=Qwen 2.5 72B, Context Length=1000 words2026.01 | 31.1 | — | |
| RAG with gMMRBackbone=Qwen 2.5 72B, Context Length=1000 words2026.01 | 30.3 | — | |
| RAG with gMMRBackbone=Llama 3.3 70B, Context Length=1000 words2026.01 | 30.1 | — | |
| GPT-4o-miniCategory=LLM-only2026.06 | 29.83 | 12.82 | |
| DF-RAG + ICBackbone=Qwen 2.5 72B, Context Length=1000 words2026.01 | 29.6 | — | |
| DF-RAGBackbone=Llama 3.3 70B, Context Length=500 words2026.01 | 29.3 | — | |
| DF-RAG + ICBackbone=Llama 3.3 70B, Context Length=1000 words2026.01 | 29.3 | — | |
| HippoRAG2+IRCoTCategory=Graph-based RAG2026.06 | 29.27 | 18.24 | |
| Vanilla RAGBackbone=Llama 3.3 70B, Context Length=1000 words2026.01 | 28.3 | — | |
| DF-RAGBackbone=Qwen 2.5 72B, Context Length=500 words2026.01 | 28.2 | — | |
| RAG with gMMRBackbone=Qwen 2.5 72B, Context Length=500 words2026.01 | 27.7 | — | |
| DF-RAG + ICBackbone=Qwen 2.5 72B, Context Length=500 words2026.01 | 27.7 | — | |
| RAG with gMMRBackbone=Llama 3.3 70B, Context Length=500 words2026.01 | 27.6 | — | |
| DF-RAG + ICBackbone=Llama 3.3 70B, Context Length=500 words2026.01 | 27.5 | — | |
| Vanilla RAGBackbone=Qwen 2.5 72B, Context Length=1000 words2026.01 | 26.9 | — | |
| RAPTORCategory=Summary-based RAG2026.06 | 26.33 | 19.65 | |
| Vanilla RAGBackbone=Llama 3.3 70B, Context Length=500 words2026.01 | 26.3 | — | |
| Vanilla RAGBackbone=Qwen 2.5 72B, Context Length=500 words2026.01 | 26.1 | — | |
| HippoRAG2Category=Graph-based RAG2026.06 | 24.45 | 17.09 | |
| LongRAGBackbone=Llama 3.3 70B, Context Length=independent2026.01 | 22.9 | — | |
| LongRAGBackbone=Qwen 2.5 72B, Context Length=independent2026.01 | 22.4 | — | |
| Self-RAGCategory=Flat RAG2026.06 | 12.84 | 4.27 |