# Query Suggestion on local life service platform ORDER (test) Source: [Query Suggestion on local life service platform ORDER (test)]() Collection index: [llms.txt]() Data updated: 2026-03-06T08:21:04.700Z Evaluation of model performance for Query Suggestion on the test split of the local life service platform ORDER dataset, measured using ranking and diversity metrics (HR@12, MRR, DIV, QUA). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Query Suggestion | | Dataset (including any stated split) | local life service platform ORDER (test) | | Metric | HR@12 | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 5 of 5 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [HR@12](): Higher is better; unit: PERCENT. - [MRR](): Higher is better; unit: PERCENT. - [DIV](): Higher is better; unit: PERCENT. - [QUA](): Higher is better; unit: PERCENT. ## Recorded results | Method | HR@12 | Result date | Report paper | | --- | --- | --- | --- | | LocalSUG | 97.09 | Not recorded | 69aa5f702d603e6de3e4180e | | OneSug\_rule | 97.07 | Not recorded | 69aa5f702d603e6de3e4180e | | SFT | 96.63 | Not recorded | 69aa5f702d603e6de3e4180e | | OneSug | 77.67 | Not recorded | 69aa5f702d603e6de3e4180e | | MCA | 76.64 | Not recorded | 69aa5f702d603e6de3e4180e | ### LocalSUG HR@12: 97.09. Result ID: 69aa8e6d6dbb7075b95440ed. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-0.6B","Training":"Beam-Search-Driven GRPO"}. This record does not assert independent reproduction. ### OneSug\_rule HR@12: 97.07. Result ID: 69aa8e6d6dbb7075b95440ec. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-0.6B","Candidates":"Co-occurrence rule-based"}. This record does not assert independent reproduction. ### SFT HR@12: 96.63. Result ID: 69aa8e6d6dbb7075b95440ea. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-0.6B","Fine-tuning":"Supervised learning"}. This record does not assert independent reproduction. ### OneSug HR@12: 77.67. Result ID: 69aa8e6d6dbb7075b95440eb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-0.6B","Framework":"End-to-end"}. This record does not assert independent reproduction. ### MCA HR@12: 76.64. Result ID: 69aa8e6d6dbb7075b95440e9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"multi-stage cascading","Retrieval":"BGE","Ranking":"DIN"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.