Retrieval on ChunQiuTR official (test)
59.23R@1CTD Qwen3-Embed-0.6B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| CTD Qwen3-Embed-0.6BType=Dense (LM-based embeddings), Setting=Fine-tuned, Pub=This work2026.04 | 59.23 | 64.85 | 69.27 | 61.94 | 45.75 | |
| CTD BERT-baseType=Dense (encoder-based), Setting=Fine-tuned, Pub=This work2026.04 | 58.26 | 67.21 | 70.9 | 61.93 | 45.75 | |
| Qwen3-Embed-0.6BType=Dense (LM-based embeddings), Setting=Fine-tuned, Pub=arXiv'252026.04 | 57.71 | 63.76 | 68.18 | 60.45 | 44.6 | |
| Qwen3-Embed-0.6B + TempDate-SmoothType=Dense (LM-based embeddings), Setting=Fine-tuned, Pub=PMLR'232026.04 | 56.38 | 63.46 | 67.27 | 59.42 | 43.96 | |
| Qwen3-Embed-0.6B + TempDateType=Dense (LM-based embeddings), Setting=Fine-tuned, Pub=SIGIR'232026.04 | 55.23 | 64.25 | 66.3 | 59.24 | 43.91 | |
| BERT-baseType=Dense (encoder-based), Setting=Fine-tuned, Pub=NAACL'192026.04 | 50.88 | 62.79 | 67.27 | 55.97 | 42.83 | |
| BERT-base + TempDate-SmoothType=Dense (encoder-based), Setting=Fine-tuned, Pub=PMLR'232026.04 | 50.51 | 61.52 | 66.73 | 55.19 | 42.44 | |
| BERT-base + TempDateType=Dense (encoder-based), Setting=Fine-tuned, Pub=SIGIR'232026.04 | 50.27 | 61.65 | 66.91 | 55.08 | 42.43 | |
| BM25+TimeKDEType=Sparse2026.04 | 49.43 | 60.86 | 67.09 | 54.56 | 42.22 | |
| Qwen3-Embed-4BType=Dense (LM-based embeddings), Setting=Zero-shot, Pub=arXiv'252026.04 | 44.1 | 57.83 | 60.13 | 49.85 | 37.93 | |
| BM25Type=Sparse2026.04 | 39.62 | 52.09 | 56.2 | 44.87 | 34.04 | |
| Qwen3-Embed-0.6BType=Dense (LM-based embeddings), Setting=Zero-shot, Pub=arXiv'252026.04 | 33.76 | 48.52 | 53.54 | 39.73 | 31.07 | |
| ColBERT-LFM2Type=Fusion, Setting=Zero-shot, Pub=arXiv'252026.04 | 33.45 | 45.67 | 48.94 | 38.65 | 26.91 | |
| mE5-LargeType=Dense (encoder-based), Setting=Zero-shot, Pub=arXiv'242026.04 | 29.16 | 39.69 | 45.74 | 33.89 | 24.41 | |
| GTE-Qwen2-1.5BType=Dense (LM-based embeddings), Setting=Zero-shot, Pub=arXiv'232026.04 | 27.83 | 44.53 | 50.09 | 35.01 | 26.13 | |
| BGE-m3Type=Dense (encoder-based), Setting=Zero-shot, Pub=Findings ACL'242026.04 | 26.98 | 37.75 | 42.53 | 31.35 | 22.99 | |
| ColBERT-JINAType=Fusion, Setting=Zero-shot, Pub=MRL'242026.04 | 24.98 | 41.02 | 47.43 | 31.67 | 25.69 | |
| mE5-Large-insType=Dense (encoder-based), Setting=Zero-shot, Pub=arXiv'242026.04 | 23.59 | 35.45 | 41.62 | 28.62 | 23.58 | |
| GTE-LargeType=Dense (encoder-based), Setting=Zero-shot, Pub=arXiv'232026.04 | 22.93 | 35.27 | 38.9 | 28.26 | 21.88 | |
| BGE-Large-v1.5Type=Dense (encoder-based), Setting=Zero-shot, Pub=arXiv'232026.04 | 22.08 | 34.3 | 41.44 | 27.75 | 22.8 | |
| E5-mistral-7BType=Dense (LM-based embeddings), Setting=Zero-shot, Pub=ACL'242026.04 | 21.96 | 32.12 | 36.84 | 26.19 | 23.59 | |
| PQR (Qwen2.5-7B)Type=Dense (LM-based embeddings), Setting=re (Retrieval-enhanced), Pub=ACL'252026.04 | 15.85 | 31.34 | 38.05 | 22.26 | 17.12 | |
| SPLADE-IDFType=Sparse, Setting=Zero-shot, Pub=arXiv'242026.04 | 13.61 | 27.65 | 35.69 | 19.71 | 15.96 | |
| PQR (Qwen3-8B)Type=Dense (LM-based embeddings), Setting=re (Retrieval-enhanced), Pub=ACL'252026.04 | 9.01 | 21.84 | 31.52 | 14.81 | 11.84 | |
| SPLADE-ℓ0Type=Sparse, Setting=Zero-shot, Pub=SIGIR'252026.04 | 0.06 | 3.09 | 5.87 | 1.32 | 1.43 |