Question Answering on SpecsQA
29.8FC F1DualGraph
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| DualGraphvariant=R+TKG_fb2026.05 | 29.8 | 35.7 | 64 | 44.1 | 16.058 | 7.678 | |
| DualGraphvariant=SKG+TKG_fb2026.05 | 29.3 | 37.2 | 64.4 | 43.4 | 16.058 | 6.802 | |
| RAPTOR2026.05 | 20.7 | 21.6 | 56.8 | 24.8 | 5.615 | 2.378 | |
| Microsoft GraphRAG2026.05 | 15.3 | 20.3 | 57.5 | 24.3 | 181.213 | 11.12 | |
| HippoRAG 22026.05 | 14.9 | 15.2 | 54 | 18.2 | 16.084 | 22.217 | |
| LinearRAG2026.05 | 13.8 | 8.5 | 52.6 | 9.3 | 0 | 7.541 | |
| Wikontic2026.05 | 13.5 | 29 | 52.3 | 34.9 | 420.325 | 138.627 | |
| LLM only2026.05 | 10.7 | 2.8 | 55.9 | 3.6 | 0 | 0.565 | |
| Vector RAG2026.05 | 9.2 | 11.8 | 43.8 | 15.8 | 0 | 2.436 | |
| TableRAG2026.05 | 9.1 | 11.8 | 45.3 | 13.9 | 0 | 20.527 | |
| Microsoft GraphRAGmode=fast2026.05 | 8.3 | 14 | 42 | 15.8 | 29.42 | 12.236 | |
| AriGraph2026.05 | 7.2 | 12.4 | 37.8 | 14 | 16.516 | 5.097 | |
| A-RAG2026.05 | 5.7 | 12.9 | 33.1 | 15.9 | 0 | 36.384 |