# Query Suggestion on Human Evaluation Query Suggestion

Source: [Query Suggestion on Human Evaluation Query Suggestion](<https://www.sota2.com/research/sota/query-suggestion-on-human-evaluation-query-suggestion>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-06T08:21:04.662Z

Human evaluation of model performance on query suggestion tasks, scored using categorical ratings such as Bad, Fair, and Good.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Query Suggestion |
| Dataset (including any stated split) | Human Evaluation Query Suggestion |
| Metric | Bad Rating Score |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 1 of 1 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Bad Rating Score](<https://www.sota2.com/research/sota/query-suggestion-on-human-evaluation-query-suggestion.md?metric=Bad%20Rating%20Score>): Lower is better; unit: SCALAR.

- [Fair Rating Score](<https://www.sota2.com/research/sota/query-suggestion-on-human-evaluation-query-suggestion.md?metric=Fair%20Rating%20Score>): Lower is better; unit: SCALAR.

- [Good Rating Score](<https://www.sota2.com/research/sota/query-suggestion-on-human-evaluation-query-suggestion.md?metric=Good%20Rating%20Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Bad Rating Score | Result date | Report paper |
| --- | --- | --- | --- |
| LocalSUG | 0.83 | Not recorded | 69aa5f702d603e6de3e4180e |

### LocalSUG

Bad Rating Score: 0.83. Result ID: 69aa8e6d6dbb7075b95440e3.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f702d603e6de3e4180e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69aa5f702d603e6de3e4180e.md>)

Recorded evaluation configuration: {"Measurement":"Relative Change vs onlineMCA"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
