Search Relevance Evaluation on Taobao AI Search Torso Queries
56.5Hit RateLEAPS-HR
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LEAPS-HRBase Model=Qwen3-14B, Optimization Objective=HR, Training Strategy=RL2026.01 | 56.5 | 67.5 | 59.2 | |
| LEAPS-ERBase Model=Qwen3-14B, Optimization Objective=ER, Training Strategy=RL2026.01 | 55.2 | 72.8 | 63.2 | |
| LEAPS-GRBase Model=Qwen3-14B, Optimization Objective=GR, Training Strategy=RL2026.01 | 53.2 | 74 | 61.2 | |
| SFT (Qwen3-14B)Base Model=Qwen3-14B, Training Strategy=SFT2026.01 | 43.6 | 58.2 | 50 | |
| SFT (Tbstar-16A2B)Base Model=Tbstar-16A2B, Training Strategy=SFT2026.01 | 43.4 | 57.9 | 49.8 | |
| Production Baseline2026.01 | 41.8 | 55.6 | 47.9 |