Skill retrieval on CHAMP
35.4nDCG@1Qwen3-32B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen3-32BRetrieval Stage=Reranker, Candidate selection=top-50 candidates retrieved by BM252026.04 | 35.4 | 41 | |
| Llama-3.3-70BRetrieval Stage=Reranker, Candidate selection=top-50 candidates retrieved by BM252026.04 | 35 | 39.1 | |
| Qwen3-235BRetrieval Stage=Reranker, Candidate selection=top-50 candidates retrieved by BM252026.04 | 34.5 | 41.5 | |
| Qwen3-4BRetrieval Stage=Reranker, Candidate selection=top-50 candidates retrieved by BM252026.04 | 30 | 35.2 | |
| Mistral3.1-24BRetrieval Stage=Reranker, Candidate selection=top-50 candidates retrieved by BM252026.04 | 27.4 | 37 | |
| Llama-3.1-8BRetrieval Stage=Reranker, Candidate selection=top-50 candidates retrieved by BM252026.04 | 25.6 | 32.1 | |
| BM25Retrieval Stage=First-stage2026.04 | 20.6 | 27.2 | |
| HybridRetrieval Stage=First-stage2026.04 | 20.6 | 28.6 | |
| BGERetrieval Stage=First-stage2026.04 | 13.5 | 22.6 | |
| TF-IDFRetrieval Stage=First-stage2026.04 | 12.1 | 17.1 | |
| ContrieverRetrieval Stage=First-stage2026.04 | 5.4 | 16.4 |