Code Retrieval on DS10K (val)
63.8nDCG@5Policy Optimization
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Policy OptimizationRetriever=Qwen3-Emb-4B2026.04 | 63.8 | 2.6 | |
| Joint AdaptationRetriever=Qwen3-Emb-4B2026.04 | 63.6 | 2.4 | |
| Policy OptimizationRetriever=OpenAI text-emb-large2026.04 | 63.3 | 7.9 | |
| Retriever Fine-tuningRetriever=Qwen3-Emb-4B2026.04 | 62.2 | 1 | |
| Direct RetrievalRetriever=Qwen3-Emb-4B2026.04 | 61.2 | 0 | |
| Zero-shot TransformationRetriever=Qwen3-Emb-4B2026.04 | 61.1 | -0.1 | |
| Joint AdaptationRetriever=Qwen3-Emb-0.6B2026.04 | 60.1 | 3.9 | |
| Retriever Fine-tuningRetriever=Qwen3-Emb-0.6B2026.04 | 58.9 | 2.7 | |
| Policy OptimizationRetriever=Qwen3-Emb-0.6B2026.04 | 58 | 1.8 | |
| Direct RetrievalRetriever=Qwen3-Emb-0.6B2026.04 | 56.2 | 0 | |
| Zero-shot TransformationRetriever=Qwen3-Emb-0.6B2026.04 | 55.9 | -0.3 | |
| Direct RetrievalRetriever=OpenAI text-emb-large2026.04 | 55.4 | 0 | |
| Policy OptimizationRetriever=OpenAI text-emb-small2026.04 | 54.9 | 7.7 | |
| Zero-shot TransformationRetriever=OpenAI text-emb-large2026.04 | 54.1 | -1.3 | |
| Zero-shot TransformationRetriever=OpenAI text-emb-small2026.04 | 47.8 | 0.6 | |
| Direct RetrievalRetriever=OpenAI text-emb-small2026.04 | 47.2 | 0 | |
| Joint AdaptationRetriever=Jina-Colbert-V22026.04 | 43.7 | 7.6 | |
| Policy OptimizationRetriever=Jina-Colbert-V22026.04 | 42.7 | 6.6 | |
| Retriever Fine-tuningRetriever=Jina-Colbert-V22026.04 | 41 | 4.9 | |
| Zero-shot TransformationRetriever=Jina-Colbert-V22026.04 | 38.4 | 2.3 | |
| Policy OptimizationRetriever=BM252026.04 | 36.4 | 13.5 | |
| Direct RetrievalRetriever=Jina-Colbert-V22026.04 | 36.1 | 0 | |
| Zero-shot TransformationRetriever=BM252026.04 | 35.8 | 12.9 | |
| Direct RetrievalRetriever=BM252026.04 | 22.9 | 0 |