Skill Routing on Skill Routing Dataset Hard
73.3Hit@1SR-Emb-8B + SR-Rank-8B
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SR-Emb-8B + SR-Rank-8BEncoder=SR-Emb-8B, Reranker=SR-Rank-8B, Rank Input=full2026.03 | 73.3 | 78.9 | |
| SR-Emb-0.6B + SR-Rank-0.6BEncoder=SR-Emb-0.6B, Reranker=SR-Rank-0.6B, Rank Input=full2026.03 | 72 | 77.3 | |
| SR-Emb-0.6B + Qwen3-Rank-8BEncoder=SR-Emb-0.6B, Reranker=Qwen3-Rank-8B, Rank Input=full2026.03 | 70.7 | 77.1 | |
| SR-Emb-0.6B + SR-Rank-8BEncoder=SR-Emb-0.6B, Reranker=SR-Rank-8B, Rank Input=full2026.03 | 70.7 | 77.8 | |
| SR-Emb-0.6B + Qwen3-Rank-0.6BEncoder=SR-Emb-0.6B, Reranker=Qwen3-Rank-0.6B, Rank Input=full2026.03 | 69.3 | 75.8 | |
| Qwen3-Emb-8B + Qwen3-Rank-8BEncoder=Qwen3-Emb-8B, Reranker=Qwen3-Rank-8B, Rank Input=full2026.03 | 68 | 74.4 | |
| Qwen3-Emb-0.6B + Qwen3-Rank-8BEncoder=Qwen3-Emb-0.6B, Reranker=Qwen3-Rank-8B, Rank Input=full2026.03 | 68 | 72.5 | |
| SR-Emb-0.6B + GPT-5.4-miniEncoder=SR-Emb-0.6B, Reranker=GPT-5.4-mini, Rank Input=full2026.03 | 65.3 | — | |
| SR-Emb-0.6B + GPT-4o-miniEncoder=SR-Emb-0.6B, Reranker=GPT-4o-mini, Rank Input=full2026.03 | 65.3 | — | |
| SR-Emb-0.6BEncoder=SR-Emb-0.6B, Reranker=None, Rank Input=N/A2026.03 | 64 | 71 | |
| Qwen3-Emb-8BEncoder=Qwen3-Emb-8B, Reranker=None, Rank Input=N/A2026.03 | 62.7 | 68.7 | |
| Qwen3-Emb-8B + GPT-4o-miniEncoder=Qwen3-Emb-8B, Reranker=GPT-4o-mini, Rank Input=full2026.03 | 62.7 | — | |
| Qwen3-Emb-0.6B + Qwen3-Rank-0.6BEncoder=Qwen3-Emb-0.6B, Reranker=Qwen3-Rank-0.6B, Rank Input=full2026.03 | 62.7 | 67.3 | |
| Qwen3-Emb-8B + GPT-5.4-miniEncoder=Qwen3-Emb-8B, Reranker=GPT-5.4-mini, Rank Input=full2026.03 | 56 | — | |
| Qwen3-Emb-0.6B + GPT-4o-miniEncoder=Qwen3-Emb-0.6B, Reranker=GPT-4o-mini, Rank Input=full2026.03 | 54.7 | — | |
| Qwen3-Emb-0.6B + GPT-5.4-miniEncoder=Qwen3-Emb-0.6B, Reranker=GPT-5.4-mini, Rank Input=full2026.03 | 54.7 | — | |
| Qwen3-Emb-8B + Qwen3-Rank-0.6BEncoder=Qwen3-Emb-8B, Reranker=Qwen3-Rank-0.6B, Rank Input=full2026.03 | 54.7 | 64.7 | |
| Qwen3-Emb-0.6BEncoder=Qwen3-Emb-0.6B, Reranker=None, Rank Input=N/A2026.03 | 53.3 | 61.8 | |
| Qwen3-Emb-0.6B + GPT-5.4-miniEncoder=Qwen3-Emb-0.6B, Reranker=GPT-5.4-mini, Rank Input=nd2026.03 | 29.3 | — | |
| Qwen3-Emb-8B + GPT-5.4-miniEncoder=Qwen3-Emb-8B, Reranker=GPT-5.4-mini, Rank Input=nd2026.03 | 26.7 | — | |
| Qwen3-Emb-0.6B + Qwen3-Rank-8BEncoder=Qwen3-Emb-0.6B, Reranker=Qwen3-Rank-8B, Rank Input=nd2026.03 | 25.3 | 38.5 | |
| Qwen3-Emb-8B + Qwen3-Rank-8BEncoder=Qwen3-Emb-8B, Reranker=Qwen3-Rank-8B, Rank Input=nd2026.03 | 18.7 | 34.8 | |
| Qwen3-Emb-0.6B + Qwen3-Rank-0.6BEncoder=Qwen3-Emb-0.6B, Reranker=Qwen3-Rank-0.6B, Rank Input=nd2026.03 | 17.3 | 32.8 | |
| Qwen3-Emb-8B + GPT-4o-miniEncoder=Qwen3-Emb-8B, Reranker=GPT-4o-mini, Rank Input=nd2026.03 | 17.3 | — | |
| Qwen3-Emb-0.6B + GPT-4o-miniEncoder=Qwen3-Emb-0.6B, Reranker=GPT-4o-mini, Rank Input=nd2026.03 | 16 | — | |
| Qwen3-Emb-8B + Qwen3-Rank-0.6BEncoder=Qwen3-Emb-8B, Reranker=Qwen3-Rank-0.6B, Rank Input=nd2026.03 | 13.3 | 31.8 |