Question Answering on UltraDomain Computer Science 1.0
41.02EMFlexStructRAG
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| FlexStructRAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v3, Retrieval Mode=hybrid mode2026.02 | 41.02 | 51.15 | 63.68 | |
| HyperGraphRAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v32026.02 | 35.94 | 45.3 | 60.57 | |
| StandardRAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v32026.02 | 28.13 | 38.14 | 56.4 | |
| Hyper-RAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v32026.02 | 25.97 | 36 | 49.04 | |
| Cog-RAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v32026.02 | 25.39 | 35.74 | 48.44 | |
| GraphRAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v32026.02 | 25.2 | 35.14 | 53.04 | |
| RAPTORBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v32026.02 | 24.22 | 34.15 | 53.23 | |
| HippoRAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v32026.02 | 19.34 | 28.51 | 48.13 | |
| LightRAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v32026.02 | 17.77 | 27.18 | 47.35 | |
| NaiveGenerationBackbone LLM=qwen-turbo-2025-07-152026.02 | 15.63 | 24.56 | 45.78 |