Question Answering on G-bench Novel
58.9AccuracyG-reasoner
Evaluation Results
| Method | Links | |
|---|---|---|
| G-reasonerReasoning LLM=GPT-4o-mini2025.09 | 58.9 | |
| GFM-RAGMethod Type=Graph-enhanced Methods, Reasoning LLM=GPT-4o-mini2025.09 | 58.6 | |
| BM25Method Type=Non-structure Methods, Reasoning LLM=GPT-4o-mini2025.09 | 56.5 | |
| HippoRAG 2Method Type=Graph-enhanced Methods, Reasoning LLM=GPT-4o-mini2025.09 | 56.5 | |
| ColBERTv2Method Type=Non-structure Methods, Reasoning LLM=GPT-4o-mini2025.09 | 56.2 | |
| Qwen3-EmbMethod Type=Non-structure Methods, Reasoning LLM=GPT-4o-mini, Parameters=8B2025.09 | 56.2 | |
| HippoRAG2Method Category=Graph-based RAG Methods2026.05 | 56.16 | |
| MemGraphRAGMethod Category=Graph-based RAG Methods2026.05 | 55.76 | |
| E2GraphRAGMethod Category=Graph-based RAG Methods2026.05 | 53.82 | |
| NoneMethod Type=Non-structure Methods, Reasoning LLM=GPT-4o-mini2025.09 | 51.4 | |
| GraphRAG (MS)Method Type=Graph-enhanced Methods, Reasoning LLM=GPT-4o-mini2025.09 | 50.9 | |
| Vanilla RAG (Top-3)Method Category=Non-structure Methods, Top-k Retrieval=32026.05 | 48.9 | |
| LazyGraphRAGMethod Category=Graph-based RAG Methods2026.05 | 48.63 | |
| MS-GraphRAGMethod Category=Graph-based RAG Methods2026.05 | 47.71 | |
| HippoRAGMethod Category=Graph-based RAG Methods2026.05 | 47.44 | |
| KGPMethod Category=Graph-based RAG Methods2026.05 | 47.04 | |
| Vanilla RAG (Top-5)Method Category=Non-structure Methods, Top-k Retrieval=52026.05 | 45.83 | |
| Vanilla RAG (Top-1)Method Category=Non-structure Methods, Top-k Retrieval=12026.05 | 45.13 | |
| LightRAGMethod Type=Graph-enhanced Methods, Reasoning LLM=GPT-4o-mini2025.09 | 45.1 | |
| HippoRAGMethod Type=Graph-enhanced Methods, Reasoning LLM=GPT-4o-mini2025.09 | 44.8 | |
| LightRAGMethod Category=Graph-based RAG Methods2026.05 | 44.67 | |
| RAPTORMethod Type=Graph-enhanced Methods, Reasoning LLM=GPT-4o-mini2025.09 | 43.2 | |
| G-retrieverMethod Category=Graph-based RAG Methods2026.05 | 43.09 | |
| RAPTORMethod Category=Graph-based RAG Methods2026.05 | 42.83 | |
| llama-70B-instructMethod Category=Non-structure Methods2026.05 | 29.73 |