E-commerce relevance modeling on JD.com advertising search engine A/B testing production (online)
1.24CTRADORE(+RD-CoT-Kto&DS&KD)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ADORE(+RD-CoT-Kto&DS&KD)Rule-aware LLM (RD)=true, Chain-of-Thought (CoT)=true, KTO alignment (Kto)=true, Data Synthesis (DS)=true, Knowledge Distillation (KD)=true2025.12 | 1.24 | 1.58 | 1.75 | |
| ADORE(+RD-CoT-Kto)Rule-aware LLM (RD)=true, Chain-of-Thought (CoT)=true, KTO alignment (Kto)=true2025.12 | 0.98 | 1.28 | 1.17 | |
| ADORE(+RD-CoT-Kto&DS)Rule-aware LLM (RD)=true, Chain-of-Thought (CoT)=true, KTO alignment (Kto)=true, Data Synthesis (DS)=true2025.12 | 0.97 | 1.07 | 1.82 | |
| ADORE(+RD-CoT)Rule-aware LLM (RD)=true, Chain-of-Thought (CoT)=true2025.12 | 0.48 | 0.23 | 0.5 |