Information-seeking conversational dialogue on MSDialog (test)
94RecallSA-RAG
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| SA-RAGBase model=LLaMA-70B, Category=Structure-aware RAG, Mode=training-free2026.05 | 94 | 80.8 | 82 | 105 | 92 | 80.4 | |
| SA-RAG-qwenBase model=Qwen-1.5B, Category=Structure-aware RAG, Mode=trained2026.05 | 72 | 38.5 | 67 | 67.5 | 70 | 37.3 | |
| TextRAG-embRetrieval Category=Text-based RAG2026.05 | 70 | 34.6 | 50 | 25 | 70 | 37.3 | |
| TextRAG-freqRetrieval Category=Text-based RAG2026.05 | 52 | — | 40 | — | 51 | — | |
| TableRAG-dirRetrieval Category=Table-based RAG2026.05 | 42 | -19.2 | 27 | -32.5 | 41 | -19.6 | |
| IE-relRetrieval Category=Information extraction (IE)2026.05 | 32 | -38.5 | 22 | -45 | 30 | -41.2 | |
| GraphRAG-KGRetrieval Category=Graph-based RAG2026.05 | 18 | -65.4 | 15 | -62.5 | 17 | -66.7 | |
| TableRAG-preRetrieval Category=Table-based RAG2026.05 | 18 | -65.4 | 15 | -62.5 | 16 | -68.6 | |
| GraphRAG-relRetrieval Category=Graph-based RAG2026.05 | 14 | -73.1 | 9 | -77.5 | 13 | -74.5 | |
| IE-ruleRetrieval Category=Information extraction (IE)2026.05 | 12 | -76.9 | 9 | -77.5 | 12 | -76.5 |