Information Retrieval on R3-Skill (test)
70.24Hit@1R3-Embedding
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| R3-Embedding2026.06 | 70.24 | 78.97 | 80.64 | 81.09 | 87.03 | 91.8 | 93.48 | 87.03 | 91.8 | 93.44 | 22.18 | |
| Qwen3-Embedding-8Bvariant=base, parameters=8B2026.06 | 62.31 | 71.05 | 73.01 | 73.76 | 79.13 | 84.98 | 87.67 | 79.13 | 84.98 | 87.67 | 10.69 | |
| SkillRet-Embedding-0.6Bparameters=0.6B2026.06 | 46.66 | 55.86 | 57.97 | 59.1 | 64.34 | 70.99 | 74.92 | 64.34 | 70.99 | 74.97 | 11.88 | |
| Qwen3-Embedding-0.6Bvariant=base, parameters=0.6B2026.06 | 43.12 | 51.58 | 53.72 | 54.74 | 59.44 | 65.82 | 69.56 | 59.44 | 65.82 | 69.56 | 4.16 | |
| BGE-M3variant=base2026.06 | 39.8 | 46.98 | 49.23 | 50.28 | 53.87 | 60.64 | 64.56 | 53.87 | 60.64 | 64.56 | 7.33 | |
| SkillRouter-Embedding-0.6Bparameters=0.6B2026.06 | 22.88 | 30.29 | 32.79 | 34.21 | 37.33 | 44.95 | 50.23 | 37.33 | 44.95 | 50.23 | 2.18 | |
| BM252026.06 | 6.04 | 8 | 8.82 | 9.25 | 9.93 | 12.41 | 14.01 | 9.93 | 12.41 | 14.01 | 0.4 |