Skill Routing on Skill Routing Dataset Easy (Hit@1, MRR)
78.7Hit@1SR-Emb-0.6B + SR-Rank-8B
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SR-Emb-0.6B + SR-Rank-8BEncoder=SR-Emb-0.6B, Reranker=SR-Rank-8B, Rank Input=full2026.03 | 78.7 | 83.1 | |
| SR-Emb-8B + SR-Rank-8BEncoder=SR-Emb-8B, Reranker=SR-Rank-8B, Rank Input=full2026.03 | 78.7 | 82.7 | |
| SR-Emb-0.6B + SR-Rank-0.6BEncoder=SR-Emb-0.6B, Reranker=SR-Rank-0.6B, Rank Input=full2026.03 | 76 | 80.9 | |
| SR-Emb-0.6B + Qwen3-Rank-0.6BEncoder=SR-Emb-0.6B, Reranker=Qwen3-Rank-0.6B, Rank Input=full2026.03 | 72 | 78 | |
| SR-Emb-0.6B + Qwen3-Rank-8BEncoder=SR-Emb-0.6B, Reranker=Qwen3-Rank-8B, Rank Input=full2026.03 | 72 | 78.1 | |
| Qwen3-Emb-0.6B + Qwen3-Rank-8BEncoder=Qwen3-Emb-0.6B, Reranker=Qwen3-Rank-8B, Rank Input=full2026.03 | 69.3 | 74.1 | |
| SR-Emb-0.6B + GPT-4o-miniEncoder=SR-Emb-0.6B, Reranker=GPT-4o-mini, Rank Input=full2026.03 | 69.3 | — | |
| Qwen3-Emb-8B + Qwen3-Rank-8BEncoder=Qwen3-Emb-8B, Reranker=Qwen3-Rank-8B, Rank Input=full2026.03 | 68 | 74.5 | |
| SR-Emb-0.6BEncoder=SR-Emb-0.6B, Reranker=None, Rank Input=N/A2026.03 | 66.7 | 73.5 | |
| Qwen3-Emb-8B + GPT-4o-miniEncoder=Qwen3-Emb-8B, Reranker=GPT-4o-mini, Rank Input=full2026.03 | 66.7 | — | |
| SR-Emb-0.6B + GPT-5.4-miniEncoder=SR-Emb-0.6B, Reranker=GPT-5.4-mini, Rank Input=full2026.03 | 66.7 | — | |
| Qwen3-Emb-8BEncoder=Qwen3-Emb-8B, Reranker=None, Rank Input=N/A2026.03 | 65.3 | 70.9 | |
| Qwen3-Emb-0.6B + Qwen3-Rank-0.6BEncoder=Qwen3-Emb-0.6B, Reranker=Qwen3-Rank-0.6B, Rank Input=full2026.03 | 65.3 | 69.5 | |
| Qwen3-Emb-8B + GPT-5.4-miniEncoder=Qwen3-Emb-8B, Reranker=GPT-5.4-mini, Rank Input=full2026.03 | 62.7 | — | |
| Qwen3-Emb-8B + Qwen3-Rank-0.6BEncoder=Qwen3-Emb-8B, Reranker=Qwen3-Rank-0.6B, Rank Input=full2026.03 | 61.3 | 69.7 | |
| Qwen3-Emb-0.6BEncoder=Qwen3-Emb-0.6B, Reranker=None, Rank Input=N/A2026.03 | 58.7 | 65.8 | |
| Qwen3-Emb-0.6B + GPT-5.4-miniEncoder=Qwen3-Emb-0.6B, Reranker=GPT-5.4-mini, Rank Input=full2026.03 | 57.3 | — | |
| Qwen3-Emb-0.6B + GPT-4o-miniEncoder=Qwen3-Emb-0.6B, Reranker=GPT-4o-mini, Rank Input=full2026.03 | 56 | — | |
| Qwen3-Emb-0.6B + GPT-5.4-miniEncoder=Qwen3-Emb-0.6B, Reranker=GPT-5.4-mini, Rank Input=nd2026.03 | 37.3 | — | |
| Qwen3-Emb-0.6B + Qwen3-Rank-0.6BEncoder=Qwen3-Emb-0.6B, Reranker=Qwen3-Rank-0.6B, Rank Input=nd2026.03 | 36 | 45.5 | |
| Qwen3-Emb-0.6B + Qwen3-Rank-8BEncoder=Qwen3-Emb-0.6B, Reranker=Qwen3-Rank-8B, Rank Input=nd2026.03 | 36 | 46.5 | |
| Qwen3-Emb-8B + GPT-5.4-miniEncoder=Qwen3-Emb-8B, Reranker=GPT-5.4-mini, Rank Input=nd2026.03 | 34.7 | — | |
| Qwen3-Emb-8B + Qwen3-Rank-8BEncoder=Qwen3-Emb-8B, Reranker=Qwen3-Rank-8B, Rank Input=nd2026.03 | 29.3 | 43.7 | |
| Qwen3-Emb-8B + Qwen3-Rank-0.6BEncoder=Qwen3-Emb-8B, Reranker=Qwen3-Rank-0.6B, Rank Input=nd2026.03 | 29.3 | 45.1 | |
| Qwen3-Emb-0.6B + GPT-4o-miniEncoder=Qwen3-Emb-0.6B, Reranker=GPT-4o-mini, Rank Input=nd2026.03 | 25.3 | — | |
| Qwen3-Emb-8B + GPT-4o-miniEncoder=Qwen3-Emb-8B, Reranker=GPT-4o-mini, Rank Input=nd2026.03 | 21.3 | — |