Query Auto-Completion on QAC Evaluation Dataset 2026 preprint (offline)
0.9772CoverageLTR + Seq2Seq
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| LTR + Seq2Seq2026.02 | 0.9772 | 0.685 | 0.0079 | 14.47 | 0.0067 | — | 0.7699 | |
| SFT-onlyGenerator Type=Compact2026.02 | 0.941 | 0.677 | 0.0104 | 2.37 | 0.0085 | 16.42 | 0.7395 | |
| SFT-onlyGenerator Type=Large2026.02 | 0.938 | 0.685 | 0.0101 | 2.37 | 0.0396 | 9.72 | 0.7578 | |
| Full (RAG + Multi-Objective DPO)Generator Type=Compact2026.02 | 0.937 | 0.682 | 0.0072 | 16.28 | 0.0059 | 15.85 | 0.7416 | |
| SFT+DPO w/o EngGenerator Type=Compact, Objective=Multi-Objective DPO without Engagement2026.02 | 0.935 | 0.687 | 0.0077 | -6.16 | 0.0064 | 14.9 | 0.736 | |
| SFT+DPO w/o EngGenerator Type=Large, Objective=Multi-Objective DPO without Engagement2026.02 | 0.931 | 0.69 | 0.0064 | -1.32 | 0.0056 | 10.54 | 0.7406 | |
| Full (RAG + Multi-Objective DPO)Generator Type=Large2026.02 | 0.93 | 0.687 | 0.0065 | 6.58 | 0.0049 | 9.43 | 0.741 | |
| LTR Baseline2026.02 | 0.846 | 0.646 | 0.0037 | — | 0.0028 | — | 0.7263 |