Search Relevance Evaluation on Taobao AI Search Tail Queries
48.5Hit RateLEAPS-HR
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LEAPS-HRBase Model=Qwen3-14B, Optimization Objective=HR, Training Strategy=RL2026.01 | 48.5 | 61 | 51 | |
| LEAPS-ERBase Model=Qwen3-14B, Optimization Objective=ER, Training Strategy=RL2026.01 | 47 | 64.7 | 54.3 | |
| LEAPS-GRBase Model=Qwen3-14B, Optimization Objective=GR, Training Strategy=RL2026.01 | 45.3 | 66 | 52.3 | |
| SFT (Qwen3-14B)Base Model=Qwen3-14B, Training Strategy=SFT2026.01 | 37.5 | 50.5 | 42.9 | |
| SFT (Tbstar-16A2B)Base Model=Tbstar-16A2B, Training Strategy=SFT2026.01 | 37.4 | 50.3 | 43.1 | |
| Production Baseline2026.01 | 36.5 | 48.8 | 41.8 |