Information-seeking conversational dialogue on CSDialog (test)
53RecallSA-RAG
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| SA-RAGBase model=LLaMA-70B, Category=Structure-aware RAG, Mode=training-free2026.05 | 53 | 130.4 | 42 | 200 | 52 | 136.4 | |
| SA-RAG-qwenBase model=Qwen-1.5B, Category=Structure-aware RAG, Mode=trained2026.05 | 41 | 78.3 | 28 | 100 | 40 | 81.8 | |
| IE-ruleRetrieval Category=Information extraction (IE)2026.05 | 32 | 39.1 | 19 | 35.7 | 29 | 31.8 | |
| TableRAG-dirRetrieval Category=Table-based RAG2026.05 | 31 | 34.8 | 25 | 78.6 | 31 | 36.4 | |
| TableRAG-preRetrieval Category=Table-based RAG2026.05 | 26 | 13 | 18 | 28.6 | 25 | 13.6 | |
| IE-relRetrieval Category=Information extraction (IE)2026.05 | 24 | 4.3 | 16 | 14.3 | 22 | 0 | |
| TextRAG-freqRetrieval Category=Text-based RAG2026.05 | 23 | — | 14 | — | 22 | — | |
| TextRAG-embRetrieval Category=Text-based RAG2026.05 | 14 | -39.1 | 8 | -42.9 | 14 | -36.4 | |
| GraphRAG-KGRetrieval Category=Graph-based RAG2026.05 | 4 | -82.6 | 2 | -85.7 | 2 | -90.9 | |
| GraphRAG-relRetrieval Category=Graph-based RAG2026.05 | 2 | -91.3 | 1 | -92.9 | 2 | -90.9 |