Scientific Paper Retrieval on SCIFULLBENCH ACL-EMNLP (References) 1.0
34.48nDCG@300COR
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| CORRetrieval Protocol=COR, Backbone Retriever=Inf-Retriever-v1-1.5B, LLM Engine=Llama-3.2-3B-Instruct2025.07 | 34.48 | 53.63 | |
| CORRetrieval Protocol=COR, Backbone Retriever=Inf-Retriever-v1-1.5B, LLM Engine=QWEN-2.5-3B-Instruct2025.07 | 34.41 | 53.3 | |
| Inf-Retriever-v1-1.5BRetrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 33.43 | 50.1 | |
| Inf-Retriever-v1-1.5BRetrieval Protocol=Full-to-Full (F2F)2025.07 | 32.86 | 48 | |
| CORRetrieval Protocol=COR, Backbone Retriever=Jina-Embeddings-v2-BASE-EN, LLM Engine=Llama-3.2-3B-Instruct2025.07 | 28.34 | 44.44 | |
| CORRetrieval Protocol=COR, Backbone Retriever=Jina-Embeddings-v2-BASE-EN, LLM Engine=QWEN-2.5-3B-Instruct2025.07 | 28.21 | 44.83 | |
| Jina-Embeddings-v2-BASE-ENRetrieval Protocol=Full-to-Full (F2F)2025.07 | 27.55 | 41.69 | |
| SciNCLRetrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 26.12 | 40.71 | |
| SPECTER2-Adapter-MTL CTRLRetrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 25.32 | 38.86 | |
| CORRetrieval Protocol=COR, Backbone Retriever=BGE-M3, LLM Engine=QWEN-2.5-3B-Instruct2025.07 | 25.22 | 39.84 | |
| SPECTER2-BaseRetrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 25.07 | 39.02 | |
| Jina-Embeddings-v2-BASE-ENRetrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 24.96 | 37.9 | |
| CORRetrieval Protocol=COR, Backbone Retriever=BGE-M3, LLM Engine=Llama-3.2-3B-Instruct2025.07 | 24.62 | 39.22 | |
| BGE-M3Retrieval Protocol=Full-to-Full (F2F)2025.07 | 24.13 | 35.88 | |
| BM-25Retrieval Protocol=Full-to-Full (F2F)2025.07 | 23.38 | 35.1 | |
| SciMult-MHAExpertRetrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 23.11 | 36.12 | |
| BGE-M3Retrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 22.95 | 34.55 | |
| BM-25Retrieval Protocol=Abstract-to-Abstract (A2A)2025.07 | 21.02 | 30.79 |