Retrieval on CPRet
75.1T2CCodeR-all-1.5B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| CodeR-all-1.5Bpruning=(1000, 1000)2026.03 | 75.1 | 85.4 | 58.4 | 94.7 | 78.3 | |
| SPLADE-Code-8Bpruning=(1000, 1000)2026.03 | 70.9 | 76.4 | 66.3 | 96.1 | 77.4 | |
| C2-LLM-7Bpruning=(1000, 1000)2026.03 | 67.8 | 75.6 | 54.6 | 94 | 73 | |
| Dense-8Bpruning=(1000, 1000)2026.03 | 64.3 | 74.2 | 72.5 | 95.3 | 76.6 | |
| SPLADE-Code-0.6Bpruning=(1000, 1000)2026.03 | 42.4 | 47.6 | 49.7 | 92.6 | 58.1 | |
| CodeXEmbed-2Bpruning=(1000, 1000)2026.03 | 39.6 | 68 | 45.3 | 86.4 | 59.8 | |
| C2-LLM-0.5Bpruning=(1000, 1000)2026.03 | 38.1 | 50.6 | 31.3 | 82.4 | 50.6 | |
| Dense-0.6Bpruning=(1000, 1000)2026.03 | 32.3 | 43.7 | 54.2 | 91.4 | 55.4 | |
| SFR-mistral-7Bpruning=(1000, 1000)2026.03 | 22.2 | 50.9 | 31.9 | 69.4 | 43.6 | |
| BM25pruning=(1000, 1000)2026.03 | 0.9 | 7.4 | 12.4 | 53.8 | 18.6 |