# Listener Response Generation on Realtalk 1.0 (user study)

Source: [Listener Response Generation on Realtalk 1.0 (user study)](<https://www.sota2.com/research/sota/listener-response-generation-on-realtalk-1-0-user-study>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-10T08:41:05.404Z

Evaluation of Listener Response Generation models on the Realtalk 1.0 (user study) dataset, assessed using human evaluation metrics such as Appropriateness, Empathy, Engagement, and Naturalness.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Listener Response Generation |
| Dataset (including any stated split) | Realtalk 1.0 (user study) |
| Metric | Appropriateness Score |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 4 of 4 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Appropriateness Score](<https://www.sota2.com/research/sota/listener-response-generation-on-realtalk-1-0-user-study.md?metric=Appropriateness%20Score>): Higher is better; unit: SCALAR.

- [Empathy Score](<https://www.sota2.com/research/sota/listener-response-generation-on-realtalk-1-0-user-study.md?metric=Empathy%20Score>): Higher is better; unit: SCALAR.

- [Engagement Score](<https://www.sota2.com/research/sota/listener-response-generation-on-realtalk-1-0-user-study.md?metric=Engagement%20Score>): Higher is better; unit: SCALAR.

- [Naturalness Score](<https://www.sota2.com/research/sota/listener-response-generation-on-realtalk-1-0-user-study.md?metric=Naturalness%20Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Appropriateness Score | Result date | Report paper |
| --- | --- | --- | --- |
| VLA model | 4.5 | Not recorded | 69afa5692d603e6de3e438b9 |
| VLA model | 3.2 | Not recorded | 69afa5692d603e6de3e438b9 |
| MMLHG | 3 | Not recorded | 69afa5692d603e6de3e438b9 |
| LM-listener | 2.7 | Not recorded | 69afa5692d603e6de3e438b9 |

### VLA model

Appropriateness Score: 4.5. Result ID: 69afd91c6dbb7075b958416e.

[Reporting paper](<https://www.sota2.com/research/paper/69afa5692d603e6de3e438b9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69afa5692d603e6de3e438b9.md>)

Recorded evaluation configuration: {"training\_stage":"SFT+RL"}. This record does not assert independent reproduction.

### VLA model

Appropriateness Score: 3.2. Result ID: 69afd91c6dbb7075b958416d.

[Reporting paper](<https://www.sota2.com/research/paper/69afa5692d603e6de3e438b9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69afa5692d603e6de3e438b9.md>)

Recorded evaluation configuration: {"training\_stage":"SFT"}. This record does not assert independent reproduction.

### MMLHG

Appropriateness Score: 3. Result ID: 69afd91c6dbb7075b958416c.

[Reporting paper](<https://www.sota2.com/research/paper/69afa5692d603e6de3e438b9.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### LM-listener

Appropriateness Score: 2.7. Result ID: 69afd91c6dbb7075b958416b.

[Reporting paper](<https://www.sota2.com/research/paper/69afa5692d603e6de3e438b9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70621e209131cea4ac8e.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.