Long-text Question Answering on UltraDomain
36.19F1 (bio)ARK
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| ARKCategory=Proposed Framework2025.11 | 36.19 | 32.59 | 38.03 | 40.16 | 37.86 | — | — | — | — | — | |
| HippoRAGCategory=Advanced RAG method2025.11 | 36.13 | 29.23 | 32.94 | 27.15 | 29.06 | 77.78 | 44.44 | 62.5 | 70 | 70 | |
| Stella-v5Category=Dense Retrieval model2025.11 | 33.85 | 32.41 | 35.02 | 35.16 | 34.09 | 72.22 | 62.5 | 64.71 | 71.43 | 89.47 | |
| Qwen3-embeddingCategory=Dense Retrieval model2025.11 | 32.99 | 29.41 | 34.9 | 38.03 | 34.04 | 95 | 85.71 | 94.74 | 78.57 | 55.56 | |
| Jina-emb-v3Category=Dense Retrieval model2025.11 | 32.88 | 29 | 33.74 | 38.74 | 36.81 | 77.78 | 61.54 | 66.67 | 58.82 | 50 | |
| BGE-M3Category=Dense Retrieval model2025.11 | 32.52 | 31.72 | 35.34 | 39.13 | 35.97 | 70.59 | 84.62 | 58.82 | 73.33 | 60 | |
| MemoRAGCategory=Advanced RAG method2025.11 | 31.08 | 27.87 | 33.26 | 39.14 | 31.98 | 92.86 | 94.12 | 84.21 | 87.5 | 88.24 | |
| FullDescription=Directly providing the entire context to an LLM2025.11 | 27.47 | 25.75 | 25.5 | 22.68 | 23.05 | 95 | 100 | 88.89 | 94.74 | 100 | |
| GraphRAGCategory=Advanced RAG method2025.11 | 18.87 | 16.92 | 14.97 | 21.93 | 20.01 | 100 | 100 | 85 | 95 | 100 | |
| LightRAGCategory=Advanced RAG method2025.11 | 16.06 | 14.13 | 15.08 | 12.19 | 14.04 | 100 | 100 | 95 | 100 | 100 |