Multi-turn Conversational Dataset Recommendation on ScienceDB offline multi-turn 1.0
0.4064Recall@1ScienceDB AI
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ScienceDB AIcore_LLM=Qwen-Plus, implementation=LangGraph2026.01 | 0.4064 | 0.4187 | 0.4196 | 0.4065 | 0.4142 | 0.4146 | 0.4065 | 0.4126 | 0.4128 | 3.19 | 2.89 | 2.83 | |
| InteRecAgent2026.01 | 0.2686 | 0.3083 | 0.3141 | 0.2686 | 0.2926 | 0.295 | 0.2684 | 0.2871 | 0.2884 | 3.2 | 3.06 | 3.05 | |
| DataLinkingfeatures=TF-IDF and concept frequency2026.01 | 0.2605 | 0.3003 | 0.3084 | 0.2605 | 0.2838 | 0.2871 | 0.2605 | 0.2781 | 0.28 | 3.23 | 3.06 | 3.03 | |
| Qwen3RAG=true, backbone=Qwen3:235B2026.01 | 0.2559 | 0.2778 | 0.2824 | 0.2559 | 0.2692 | 0.2712 | 0.2559 | 0.2662 | 0.2673 | 3.21 | 3.17 | 3.15 | |
| DeepSeek-V3RAG=true, backbone=DeepSeek-V3:671b2026.01 | 0.2277 | 0.2513 | 0.253 | 0.2277 | 0.242 | 0.2428 | 0.2277 | 0.2388 | 0.2392 | 3.33 | 3.24 | 3.23 | |
| CoSearchAgent2026.01 | 0.1608 | 0.1988 | 0.2386 | 0.1608 | 0.1822 | 0.1984 | 0.1608 | 0.1766 | 0.1854 | 3.41 | 3.31 | 3.25 | |
| DataFinderembedding_model=BERT2026.01 | 0.0115 | 0.0726 | 0.1481 | 0.0115 | 0.0455 | 0.0764 | 0.0115 | 0.0363 | 0.0533 | 3.35 | 3.09 | 3.01 |