Reranking on SkillRet official (test)
81.68NDCG@5R3-Reranker
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| R3-RerankerUpstream embedding=R3-Embedding (ours)2026.06 | 81.68 | 82.94 | 83.32 | 84.19 | 87.6 | 88.9 | 72.86 | 77.13 | 78.71 | |
| SkillRet-Reranker-0.6BUpstream embedding=SkillRet-Embedding-0.6B2026.06 | 80.71 | 82.18 | 82.66 | 83.73 | 87.61 | 89.2 | 73.28 | 78.95 | 81.09 | |
| SkillRouter-Reranker-0.6BUpstream embedding=R3-Embedding (ours)2026.06 | 80.49 | 82.15 | 82.71 | 82.98 | 87.3 | 89.11 | 70.46 | 76.33 | 78.89 | |
| SkillRouter-Reranker-0.6BUpstream embedding=SkillRet-Embedding-0.6B2026.06 | 79.98 | 81.85 | 82.37 | 82.85 | 87.64 | 89.24 | 70.66 | 78.15 | 80.75 | |
| Embedding onlyUpstream embedding=SkillRet-Embedding-0.6B2026.06 | 75.57 | 78.03 | 78.87 | 79.15 | 85.42 | 88.09 | 65.96 | 75.09 | 79.03 | |
| Qwen3-Reranker-4BUpstream embedding=SkillRet-Embedding-0.6B2026.06 | 73.24 | 76.2 | 77.12 | 78.58 | 86.18 | 89.04 | 65.52 | 76.09 | 80.47 | |
| Qwen3-Reranker-0.6BUpstream embedding=R3-Embedding (ours)2026.06 | 73.24 | 76.03 | 76.97 | 78.34 | 85.69 | 88.7 | 64.52 | 74.28 | 78.47 | |
| Qwen3-Reranker-8BUpstream embedding=SkillRet-Embedding-0.6B2026.06 | 73.21 | 76.09 | 76.92 | 79.12 | 86.48 | 89.07 | 66.4 | 76.53 | 80.67 | |
| Qwen3-Reranker-0.6BUpstream embedding=SkillRet-Embedding-0.6B2026.06 | 72.84 | 75.81 | 76.68 | 78.23 | 85.86 | 88.57 | 64.72 | 75.48 | 79.93 |