Multilingual Information Retrieval on TREC NeuCLIR 2023 (test)
43nDCG@20Qwen3 Embedding
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Qwen3 EmbeddingArchitecture=Dense retrieval, Inference Engine=vLLM, Precision=FP16, Index=FAISS (PQ2048x4fs), Serving Framework=RoutIR, Hardware=NVIDIA TITAN RTX 24G2026.01 | 43 | 9.6 | 1.23 | |
| MILCOArchitecture=Learned-sparse retrieval (LSR), Backbone=XLM-RoBERTa-Large, Search Engine=Anserini, Serving Framework=RoutIR, Hardware=NVIDIA TITAN RTX 24G2026.01 | 41.3 | 3.27 | 2.46 | |
| PLAID-XArchitecture=Multi-Vector dense, Backbone=XLM-RoBERTa-Large, Serving Framework=RoutIR, Hardware=NVIDIA TITAN RTX 24G2026.01 | 40.2 | 7.05 | 0.24 |