Question Answering on Geography
9.3BLEUHypercube-RAG
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Hypercube-RAGRetrieval Strategy=Our Method, Base Model=GPT-4o2026.05 | 9.3 | 76.8 | 83.6 | 74.8 | |
| HippoRAG 2Retrieval Strategy=Graph-based RAG, Base Model=GPT-4o2026.05 | 9.2 | 74.6 | 80.6 | 67.5 | |
| BM25Retrieval Strategy=Sparse and Dense Embedding Retrieval, Base Model=GPT-4o2026.05 | 7.9 | 73.3 | 79.7 | 70.8 | |
| HippoRAGRetrieval Strategy=Graph-based RAG, Base Model=GPT-4o2026.05 | 7.8 | 70.3 | 76.9 | 69.7 | |
| ContrieverRetrieval Strategy=Sparse and Dense Embedding Retrieval, Base Model=GPT-4o2026.05 | 7.5 | 74.1 | 82.5 | 73.6 | |
| NV-EmbedRetrieval Strategy=Sparse and Dense Embedding Retrieval, Base Model=GPT-4o2026.05 | 7.5 | 75.4 | 81.9 | 72.3 | |
| e5Retrieval Strategy=Sparse and Dense Embedding Retrieval, Base Model=GPT-4o2026.05 | 7.1 | 73.9 | 81.2 | 71.2 | |
| LightRAGRetrieval Strategy=Graph-based RAG, Base Model=GPT-4o2026.05 | 7 | 67.8 | 69.8 | 59.6 | |
| GraphRAGRetrieval Strategy=Graph-based RAG, Base Model=GPT-4o2026.05 | 6.9 | 69.4 | 70.6 | 63.8 | |
| Llama-4-Scout-17B-16E-InstructRetrieval Strategy=No Retrieval2026.05 | 3.1 | 61.3 | 48.8 | 21.9 | |
| GPT-4oRetrieval Strategy=No Retrieval2026.05 | 2.8 | 63.9 | 64.2 | 42.1 | |
| Qwen2.5-7B-InstructRetrieval Strategy=No Retrieval2026.05 | 1.7 | 47.1 | 32.1 | 12.6 | |
| Llama-3.3-70B-InstructRetrieval Strategy=No Retrieval2026.05 | 1.6 | 51.3 | 49.3 | 21.2 | |
| DeepSeek-R1Retrieval Strategy=No Retrieval2026.05 | 1.3 | 61.7 | 57.9 | 45.7 |