Search Relevance on Minor Language family Qwen2.5 series benchmark (test)
84.99NDCG@1SERM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SERMBase Model Scale=Qwen2.5-7B, Iteration/Distillation Stage=Iteration 32026.01 | 84.99 | 85.12 | 55.07 | |
| SERMBase Model Scale=Qwen2.5-7B, Iteration/Distillation Stage=Iteration 22026.01 | 84.79 | 85.05 | 54.4 | |
| SERMBase Model Scale=Qwen2.5-1.5B, Iteration/Distillation Stage=Iteration 32026.01 | 84.75 | 85.03 | 54.35 | |
| SERMBase Model Scale=Qwen2.5-7B, Iteration/Distillation Stage=Iteration 12026.01 | 84.55 | 84.96 | 54.24 | |
| SERMBase Model Scale=Qwen2.5-1.5B, Iteration/Distillation Stage=Iteration 22026.01 | 84.46 | 84.93 | 54.07 | |
| SERMBase Model Scale=Qwen2.5-7B, Iteration/Distillation Stage=Distillation (0.5B)2026.01 | 84.43 | 84.78 | 54.42 | |
| SERMBase Model Scale=Qwen2.5-1.5B, Iteration/Distillation Stage=Distillation (0.5B)2026.01 | 84.4 | 84.6 | 53.68 | |
| SERMBase Model Scale=Qwen2.5-1.5B, Iteration/Distillation Stage=Iteration 12026.01 | 84.11 | 84.81 | 53.51 | |
| Self-TrainingBase Model Scale=Qwen2.5-7B, Iteration/Distillation Stage=Iteration 12026.01 | 82.3 | 84.12 | 53.83 | |
| Self-TrainingBase Model Scale=Qwen2.5-7B, Iteration/Distillation Stage=Iteration 22026.01 | 82.29 | 84.12 | 54.25 | |
| Self-TrainingBase Model Scale=Qwen2.5-7B, Iteration/Distillation Stage=Iteration 32026.01 | 82.2 | 84.08 | 54.45 | |
| Self-TrainingBase Model Scale=Qwen2.5-1.5B, Iteration/Distillation Stage=Iteration 32026.01 | 82.19 | 84.09 | 53.74 | |
| Self-TrainingBase Model Scale=Qwen2.5-1.5B, Iteration/Distillation Stage=Iteration 22026.01 | 82.1 | 84.05 | 53.32 | |
| CT+SFTBase Model Scale=Qwen2.5-7B2026.01 | 82.02 | 84.02 | 52.89 | |
| Self-TrainingBase Model Scale=Qwen2.5-1.5B, Iteration/Distillation Stage=Iteration 12026.01 | 82 | 84.02 | 53.09 | |
| CT+SFTBase Model Scale=Qwen2.5-1.5B2026.01 | 81.75 | 83.91 | 51.81 | |
| Self-TrainingBase Model Scale=Qwen2.5-1.5B, Iteration/Distillation Stage=Distillation (0.5B)2026.01 | 81.65 | 83.49 | 52.86 | |
| Self-TrainingBase Model Scale=Qwen2.5-7B, Iteration/Distillation Stage=Distillation (0.5B)2026.01 | 81.47 | 83.5 | 53.73 |