# Dialogue Evaluation on Ice-breaker human evaluation 1.0 (test) Source: [Dialogue Evaluation on Ice-breaker human evaluation 1.0 (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:54:32.783Z Subjective human evaluation of dialogue quality on the Ice-breaker human evaluation 1.0 test set, focusing on metrics related to engagement, consistency, fluency, and topic adherence. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Dialogue Evaluation | | Dataset (including any stated split) | Ice-breaker human evaluation 1.0 (test) | | Metric | Overall Score | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 10 of 10 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Overall Score](): Higher is better; unit: SCALAR. - [Interestingness](): Higher is better; unit: SCALAR. - [Fun Score](): Higher is better; unit: SCALAR. - [Consistency](): Higher is better; unit: SCALAR. - [Fluency](): Higher is better; unit: SCALAR. - [Topic Adherence](): Higher is better; unit: SCALAR. - [Robotic Score](): Lower is better; unit: SCALAR. - [Repetitiveness](): Lower is better; unit: SCALAR. ## Recorded results | Method | Overall Score | Result date | Report paper | | --- | --- | --- | --- | | Model A | 0.552 | Not recorded | 68fa6bfd1e209131cea317ab | | Model A | 0.422 | Not recorded | 68fa6bfd1e209131cea317ab | | Model B | 0.376 | Not recorded | 68fa6bfd1e209131cea317ab | | Model C | 0.322 | Not recorded | 68fa6bfd1e209131cea317ab | | Model B | 0.273 | Not recorded | 68fa6bfd1e209131cea317ab | | Model C | 0.222 | Not recorded | 68fa6bfd1e209131cea317ab | | Model D | -0.139 | Not recorded | 68fa6bfd1e209131cea317ab | | Model E | -0.198 | Not recorded | 68fa6bfd1e209131cea317ab | | Model E | -0.24 | Not recorded | 68fa6bfd1e209131cea317ab | | Model D | -0.267 | Not recorded | 68fa6bfd1e209131cea317ab | ### Model A Overall Score: 0.552. Result ID: 698eb530ffc3901de09ff96c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"number of ratings":721,"persona":false}. This record does not assert independent reproduction. ### Model A Overall Score: 0.422. Result ID: 698eb530ffc3901de09ff96d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"number of ratings":742,"persona":true}. This record does not assert independent reproduction. ### Model B Overall Score: 0.376. Result ID: 698eb530ffc3901de09ff96e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"number of ratings":721,"persona":false}. This record does not assert independent reproduction. ### Model C Overall Score: 0.322. Result ID: 698eb530ffc3901de09ff96f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"number of ratings":784,"persona":false}. This record does not assert independent reproduction. ### Model B Overall Score: 0.273. Result ID: 698eb530ffc3901de09ff970. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"number of ratings":658,"persona":true}. This record does not assert independent reproduction. ### Model C Overall Score: 0.222. Result ID: 698eb530ffc3901de09ff971. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"number of ratings":700,"persona":true}. This record does not assert independent reproduction. ### Model D Overall Score: -0.139. Result ID: 698eb530ffc3901de09ff972. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"number of ratings":728,"persona":false}. This record does not assert independent reproduction. ### Model E Overall Score: -0.198. Result ID: 698eb530ffc3901de09ff973. [Reporting paper]() Recorded evaluation configuration: {"number of ratings":714,"persona":true}. This record does not assert independent reproduction. ### Model E Overall Score: -0.24. Result ID: 698eb530ffc3901de09ff974. [Reporting paper]() Recorded evaluation configuration: {"number of ratings":721,"persona":false}. This record does not assert independent reproduction. ### Model D Overall Score: -0.267. Result ID: 698eb530ffc3901de09ff975. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"number of ratings":721,"persona":true}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.