List your company

Query Auto-Completion on Human Evaluation Set

69.9Item-wise ScoreFull
65.11666.35867.668.842Feb 1, 2026

Evaluation results

MethodLinks
FullDeployment Strategy=hybrid deployment (Large Generator offline + Compact Generator online), Alignment=Multi-Objective DPO2026.0269.90.4
SFT + DPO w/o EngDeployment Strategy=hybrid deployment (Large Generator offline + Compact Generator online), Engagement Objective=excluded2026.0269.80.69
SFT-onlyDeployment Strategy=hybrid deployment (Large Generator offline + Compact Generator online)2026.0268.90.5
LTR BaselineDeployment Strategy=hybrid deployment (Large Generator offline + Compact Generator online)2026.0265.3—