# Dialogue Shift on Dialogue shift Overall

Source: [Dialogue Shift on Dialogue shift Overall](<https://www.sota2.com/research/sota/dialogue-shift-on-dialogue-shift-overall>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-08T10:28:08.916Z

Evaluation of dialogue system performance focusing on alignment and quality metrics using the Dialogue shift Overall dataset.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Dialogue Shift |
| Dataset (including any stated split) | Dialogue shift Overall |
| Metric | Alignment Score |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 6 of 6 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Alignment Score](<https://www.sota2.com/research/sota/dialogue-shift-on-dialogue-shift-overall.md?metric=Alignment%20Score>): Higher is better; unit: SCALAR.

- [Dialogue Quality Score](<https://www.sota2.com/research/sota/dialogue-shift-on-dialogue-shift-overall.md?metric=Dialogue%20Quality%20Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Alignment Score | Result date | Report paper |
| --- | --- | --- | --- |
| CAA | 1.554 | Not recorded | 69fd6e1c5497b3b670c89492 |
| Memory Inception | 1.516 | Not recorded | 69fd6e1c5497b3b670c89492 |
| Prompt-init | 1.178 | Not recorded | 69fd6e1c5497b3b670c89492 |
| Memory Inception | 0.816 | Not recorded | 69fd6e1c5497b3b670c89492 |
| CAA | 0.526 | Not recorded | 69fd6e1c5497b3b670c89492 |
| Prompt-init | 0.438 | Not recorded | 69fd6e1c5497b3b670c89492 |

### CAA

Alignment Score: 1.554. Result ID: 69fdbab147f34ce924e153ae.

[Reporting paper](<https://www.sota2.com/research/paper/69fd6e1c5497b3b670c89492.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74051e209131cea5f4ad.md>)

Recorded evaluation configuration: {"Model":"Llama3.1-8B","Setting":"Overall"}. This record does not assert independent reproduction.

### Memory Inception

Alignment Score: 1.516. Result ID: 69fdbab147f34ce924e153af.

[Reporting paper](<https://www.sota2.com/research/paper/69fd6e1c5497b3b670c89492.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69fd6e1c5497b3b670c89492.md>)

Recorded evaluation configuration: {"Model":"Llama3.1-8B","Setting":"Overall"}. This record does not assert independent reproduction.

### Prompt-init

Alignment Score: 1.178. Result ID: 69fdbab147f34ce924e153ad.

[Reporting paper](<https://www.sota2.com/research/paper/69fd6e1c5497b3b670c89492.md>)

Recorded evaluation configuration: {"Model":"Llama3.1-8B","Setting":"Overall"}. This record does not assert independent reproduction.

### Memory Inception

Alignment Score: 0.816. Result ID: 69fdbab147f34ce924e153ac.

[Reporting paper](<https://www.sota2.com/research/paper/69fd6e1c5497b3b670c89492.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69fd6e1c5497b3b670c89492.md>)

Recorded evaluation configuration: {"Model":"Qwen3-30B-A3B","Setting":"Overall"}. This record does not assert independent reproduction.

### CAA

Alignment Score: 0.526. Result ID: 69fdbab147f34ce924e153ab.

[Reporting paper](<https://www.sota2.com/research/paper/69fd6e1c5497b3b670c89492.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74051e209131cea5f4ad.md>)

Recorded evaluation configuration: {"Model":"Qwen3-30B-A3B","Setting":"Overall"}. This record does not assert independent reproduction.

### Prompt-init

Alignment Score: 0.438. Result ID: 69fdbab147f34ce924e153aa.

[Reporting paper](<https://www.sota2.com/research/paper/69fd6e1c5497b3b670c89492.md>)

Recorded evaluation configuration: {"Model":"Qwen3-30B-A3B","Setting":"Overall"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.