Question Answering on UltraDomain Agriculture 1.0
34.96Exact Match (EM)FlexStructRAG
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| FlexStructRAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v3, Retrieval Mode=hybrid mode2026.02 | 34.96 | 44.75 | 60.59 | |
| HyperGraphRAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v3, Retrieval=hypergraph structure2026.02 | 29.1 | 39.23 | 57.83 | |
| StandardRAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v3, Retrieval=canonical chunk-based2026.02 | 18.75 | 28.75 | 51.88 | |
| LightRAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v3, Retrieval=graph-based2026.02 | 17.58 | 25.51 | 46.67 | |
| GraphRAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v3, Retrieval=graph-based2026.02 | 17.58 | 26.02 | 47.03 | |
| Cog-RAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v3, Retrieval=hypergraph structure2026.02 | 17.57 | 24.72 | 41.82 | |
| Hyper-RAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v3, Retrieval=hypergraph structure2026.02 | 17.57 | 25.74 | 42.88 | |
| RAPTORBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v3, Retrieval=hierarchical chunk clustering2026.02 | 16.6 | 24.6 | 47.68 | |
| HippoRAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v3, Retrieval=graph-based2026.02 | 13.28 | 19.42 | 43.44 | |
| NaiveGenerationBackbone LLM=qwen-turbo-2025-07-15, Retrieval=None2026.02 | 9.38 | 15.38 | 39.8 |