Question Answering on UltraDomain Legal 1.0
35.16EMFlexStructRAG
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| FlexStructRAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v3, Retrieval Mode=hybrid mode2026.02 | 35.16 | 45.61 | 59.4 | |
| HyperGraphRAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v32026.02 | 31.84 | 42.29 | 57.19 | |
| StandardRAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v32026.02 | 27.73 | 38.51 | 54.98 | |
| Hyper-RAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v32026.02 | 23.04 | 34.76 | 47.28 | |
| Cog-RAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v32026.02 | 22.65 | 32.97 | 45.15 | |
| GraphRAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v32026.02 | 21.48 | 31.21 | 48.01 | |
| RAPTORBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v32026.02 | 21.29 | 32.38 | 49.79 | |
| LightRAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v32026.02 | 19.92 | 29.13 | 45.2 | |
| HippoRAGBackbone LLM=qwen-turbo-2025-07-15, Embedding Model=text-embedding-v32026.02 | 18.75 | 28.75 | 45.94 | |
| NaiveGenerationBackbone LLM=qwen-turbo-2025-07-152026.02 | 12.5 | 23.88 | 42.82 |