Citation Recommendation on Microsoft Academic Graph (MAG) 1,000-paper (test)
47.43Recall@10alpha*BM25 + (1-alpha) * SBERT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| alpha*BM25 + (1-alpha) * SBERTCategory=Hybrid, alpha=0.52025.12 | 47.43 | 4.73 | 15.85 | 19.32 | |
| BM25Category=Traditional IR2025.12 | 33.76 | 4.1 | 14.52 | 17.25 | |
| SBERTCategory=Dense Embeddings2025.12 | 32.47 | 3.97 | 12.33 | 15.73 | |
| Attention based subgraph retriever+LLM rerankingCategory=Our Model+LLM Reasoning, Evaluation Subset Size=100 papers2025.12 | 0.3 | 0.23 | 0.03 | 0 | |
| Attention based subgraph retrieverCategory=Our Model2025.12 | 0.24 | 0.26 | 1.77 | 1.38 |