Code Retrieval on MTEB Code (val)
74nDCG@5Retriever Fine-tuning
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Retriever Fine-tuningRetriever=Qwen3-Emb-4B2026.04 | 74 | 0.9 | |
| Policy OptimizationRetriever=Qwen3-Emb-4B2026.04 | 73.5 | 0.4 | |
| Joint AdaptationRetriever=Qwen3-Emb-4B2026.04 | 73.2 | 0.1 | |
| Direct RetrievalRetriever=Qwen3-Emb-4B2026.04 | 73.1 | 0 | |
| Zero-shot TransformationRetriever=Qwen3-Emb-4B2026.04 | 71.8 | -1.3 | |
| Joint AdaptationRetriever=Qwen3-Emb-0.6B2026.04 | 71.5 | 2.9 | |
| Policy OptimizationRetriever=Qwen3-Emb-0.6B2026.04 | 70.6 | 2 | |
| Retriever Fine-tuningRetriever=Qwen3-Emb-0.6B2026.04 | 69.9 | 1.3 | |
| Zero-shot TransformationRetriever=Qwen3-Emb-0.6B2026.04 | 69.4 | 0.8 | |
| Direct RetrievalRetriever=Qwen3-Emb-0.6B2026.04 | 68.6 | 0 | |
| Policy OptimizationRetriever=OpenAI text-emb-large2026.04 | 68.5 | 2.2 | |
| Zero-shot TransformationRetriever=OpenAI text-emb-large2026.04 | 67.1 | 0.8 | |
| Policy OptimizationRetriever=OpenAI text-emb-small2026.04 | 66.8 | 8.1 | |
| Direct RetrievalRetriever=OpenAI text-emb-large2026.04 | 66.3 | 0 | |
| Zero-shot TransformationRetriever=OpenAI text-emb-small2026.04 | 64.5 | 5.8 | |
| Joint AdaptationRetriever=Jina-Colbert-V22026.04 | 61.8 | 13.2 | |
| Policy OptimizationRetriever=Jina-Colbert-V22026.04 | 60.5 | 11.9 | |
| Retriever Fine-tuningRetriever=Jina-Colbert-V22026.04 | 59.1 | 10.5 | |
| Direct RetrievalRetriever=OpenAI text-emb-small2026.04 | 58.7 | 0 | |
| Zero-shot TransformationRetriever=Jina-Colbert-V22026.04 | 57.9 | 9.3 | |
| Direct RetrievalRetriever=Jina-Colbert-V22026.04 | 48.6 | 0 | |
| Policy OptimizationRetriever=BM252026.04 | 46.6 | 31 | |
| Zero-shot TransformationRetriever=BM252026.04 | 42.8 | 27.2 | |
| Direct RetrievalRetriever=BM252026.04 | 15.6 | 0 |