# Dialogue Generation on Proposed Multi-scenario Dataset 1.0 (test)

Source: [Dialogue Generation on Proposed Multi-scenario Dataset 1.0 (test)](<https://www.sota2.com/research/sota/dialogue-generation-on-proposed-multi-scenario-dataset-1-0-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:26:54.056Z

Evaluation of Dialogue Generation performance on the test split of the Proposed Multi-scenario Dataset 1.0, measured using accuracy metrics (Acc T, Acc C, Acc P, Acc D).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Dialogue Generation |
| Dataset (including any stated split) | Proposed Multi-scenario Dataset 1.0 (test) |
| Metric | Acc T |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 18 of 18 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Acc T](<https://www.sota2.com/research/sota/dialogue-generation-on-proposed-multi-scenario-dataset-1-0-test.md?metric=Acc%20T>): Higher is better; unit: PERCENT.

- [Acc C](<https://www.sota2.com/research/sota/dialogue-generation-on-proposed-multi-scenario-dataset-1-0-test.md?metric=Acc%20C>): Higher is better; unit: PERCENT.

- [Acc P](<https://www.sota2.com/research/sota/dialogue-generation-on-proposed-multi-scenario-dataset-1-0-test.md?metric=Acc%20P>): Higher is better; unit: PERCENT.

- [Acc D](<https://www.sota2.com/research/sota/dialogue-generation-on-proposed-multi-scenario-dataset-1-0-test.md?metric=Acc%20D>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Acc T | Result date | Report paper |
| --- | --- | --- | --- |
| SGM | 86.37 | Not recorded | 68fa771f1e209131cea7135b |
| CoT+SOP | 82.09 | Not recorded | 68fa771f1e209131cea7135b |
| SGM | 78.35 | Not recorded | 68fa771f1e209131cea7135b |
| SGM | 77.83 | Not recorded | 68fa771f1e209131cea7135b |
| SGM | 76.52 | Not recorded | 68fa771f1e209131cea7135b |
| CoT+SOP | 74.25 | Not recorded | 68fa771f1e209131cea7135b |
| CoT | 69.64 | Not recorded | 68fa771f1e209131cea7135b |
| CoT | 68.57 | Not recorded | 68fa771f1e209131cea7135b |
| CoT | 65.43 | Not recorded | 68fa771f1e209131cea7135b |
| CoT+SOP | 63.24 | Not recorded | 68fa771f1e209131cea7135b |
| SGM | 61.76 | Not recorded | 68fa771f1e209131cea7135b |
| CoT+SOP | 55.64 | Not recorded | 68fa771f1e209131cea7135b |
| CoT+SOP | 52.24 | Not recorded | 68fa771f1e209131cea7135b |
| CoT | 50.47 | Not recorded | 68fa771f1e209131cea7135b |
| CoT | 48.57 | Not recorded | 68fa771f1e209131cea7135b |
| SGM | 46.85 | Not recorded | 68fa771f1e209131cea7135b |
| CoT+SOP | 38.72 | Not recorded | 68fa771f1e209131cea7135b |
| CoT | 31.79 | Not recorded | 68fa771f1e209131cea7135b |

### SGM

Acc T: 86.37. Result ID: 6994758b3a6c3148491d63c1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

Recorded evaluation configuration: {"Model":"GPT-4o"}. This record does not assert independent reproduction.

### CoT+SOP

Acc T: 82.09. Result ID: 6994758b3a6c3148491d63c0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

Recorded evaluation configuration: {"Model":"GPT-4o"}. This record does not assert independent reproduction.

### SGM

Acc T: 78.35. Result ID: 6994758b3a6c3148491d63d0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

Recorded evaluation configuration: {"Model":"Llama3-70b"}. This record does not assert independent reproduction.

### SGM

Acc T: 77.83. Result ID: 6994758b3a6c3148491d63cd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

Recorded evaluation configuration: {"Model":"Qwen1.5-72b"}. This record does not assert independent reproduction.

### SGM

Acc T: 76.52. Result ID: 6994758b3a6c3148491d63c4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

Recorded evaluation configuration: {"Model":"GPT-3.5"}. This record does not assert independent reproduction.

### CoT+SOP

Acc T: 74.25. Result ID: 6994758b3a6c3148491d63cc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

Recorded evaluation configuration: {"Model":"Qwen1.5-72b"}. This record does not assert independent reproduction.

### CoT

Acc T: 69.64. Result ID: 6994758b3a6c3148491d63bf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Model":"GPT-4o"}. This record does not assert independent reproduction.

### CoT

Acc T: 68.57. Result ID: 6994758b3a6c3148491d63cb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Model":"Qwen1.5-72b"}. This record does not assert independent reproduction.

### CoT

Acc T: 65.43. Result ID: 6994758b3a6c3148491d63ce.

[Reporting paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Model":"Llama3-70b"}. This record does not assert independent reproduction.

### CoT+SOP

Acc T: 63.24. Result ID: 6994758b3a6c3148491d63c3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

Recorded evaluation configuration: {"Model":"GPT-3.5"}. This record does not assert independent reproduction.

### SGM

Acc T: 61.76. Result ID: 6994758b3a6c3148491d63c7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

Recorded evaluation configuration: {"Model":"Qwen1.5-14b"}. This record does not assert independent reproduction.

### CoT+SOP

Acc T: 55.64. Result ID: 6994758b3a6c3148491d63c6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

Recorded evaluation configuration: {"Model":"Qwen1.5-14b"}. This record does not assert independent reproduction.

### CoT+SOP

Acc T: 52.24. Result ID: 6994758b3a6c3148491d63cf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

Recorded evaluation configuration: {"Model":"Llama3-70b"}. This record does not assert independent reproduction.

### CoT

Acc T: 50.47. Result ID: 6994758b3a6c3148491d63c5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Model":"Qwen1.5-14b"}. This record does not assert independent reproduction.

### CoT

Acc T: 48.57. Result ID: 6994758b3a6c3148491d63c2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Model":"GPT-3.5"}. This record does not assert independent reproduction.

### SGM

Acc T: 46.85. Result ID: 6994758b3a6c3148491d63ca.

[Reporting paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

Recorded evaluation configuration: {"Model":"Llama3-8b"}. This record does not assert independent reproduction.

### CoT+SOP

Acc T: 38.72. Result ID: 6994758b3a6c3148491d63c9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

Recorded evaluation configuration: {"Model":"Llama3-8b"}. This record does not assert independent reproduction.

### CoT

Acc T: 31.79. Result ID: 6994758b3a6c3148491d63c8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa771f1e209131cea7135b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Model":"Llama3-8b"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
