# Dialogue Shift on Dialogue shift 24 turns

Source: [Dialogue Shift on Dialogue shift 24 turns](<https://www.sota2.com/research/sota/dialogue-shift-on-dialogue-shift-24-turns>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-08T10:28:08.951Z

Evaluation of dialogue systems focusing on shift capability using the 'Dialogue shift 24 turns' dataset, measured by Alignment and Quality metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Dialogue Shift |
| Dataset (including any stated split) | Dialogue shift 24 turns |
| Metric | Alignment Score |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 6 of 6 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Alignment Score](<https://www.sota2.com/research/sota/dialogue-shift-on-dialogue-shift-24-turns.md?metric=Alignment%20Score>): Higher is better; unit: SCALAR.

- [Dialogue Quality Score](<https://www.sota2.com/research/sota/dialogue-shift-on-dialogue-shift-24-turns.md?metric=Dialogue%20Quality%20Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Alignment Score | Result date | Report paper |
| --- | --- | --- | --- |
| CAA | 1.38 | Not recorded | 69fd6e1c5497b3b670c89492 |
| Memory Inception | 1.344 | Not recorded | 69fd6e1c5497b3b670c89492 |
| Prompt-init | 0.964 | Not recorded | 69fd6e1c5497b3b670c89492 |
| Memory Inception | 0.651 | Not recorded | 69fd6e1c5497b3b670c89492 |
| CAA | 0.497 | Not recorded | 69fd6e1c5497b3b670c89492 |
| Prompt-init | 0.344 | Not recorded | 69fd6e1c5497b3b670c89492 |

### CAA

Alignment Score: 1.38. Result ID: 69fdbab147f34ce924e153b4.

[Reporting paper](<https://www.sota2.com/research/paper/69fd6e1c5497b3b670c89492.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74051e209131cea5f4ad.md>)

Recorded evaluation configuration: {"Model":"Llama3.1-8B","Setting":"24 turns"}. This record does not assert independent reproduction.

### Memory Inception

Alignment Score: 1.344. Result ID: 69fdbab147f34ce924e153b5.

[Reporting paper](<https://www.sota2.com/research/paper/69fd6e1c5497b3b670c89492.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69fd6e1c5497b3b670c89492.md>)

Recorded evaluation configuration: {"Model":"Llama3.1-8B","Setting":"24 turns"}. This record does not assert independent reproduction.

### Prompt-init

Alignment Score: 0.964. Result ID: 69fdbab147f34ce924e153b3.

[Reporting paper](<https://www.sota2.com/research/paper/69fd6e1c5497b3b670c89492.md>)

Recorded evaluation configuration: {"Model":"Llama3.1-8B","Setting":"24 turns"}. This record does not assert independent reproduction.

### Memory Inception

Alignment Score: 0.651. Result ID: 69fdbab147f34ce924e153b2.

[Reporting paper](<https://www.sota2.com/research/paper/69fd6e1c5497b3b670c89492.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69fd6e1c5497b3b670c89492.md>)

Recorded evaluation configuration: {"Model":"Qwen3-30B-A3B","Setting":"24 turns"}. This record does not assert independent reproduction.

### CAA

Alignment Score: 0.497. Result ID: 69fdbab147f34ce924e153b1.

[Reporting paper](<https://www.sota2.com/research/paper/69fd6e1c5497b3b670c89492.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74051e209131cea5f4ad.md>)

Recorded evaluation configuration: {"Model":"Qwen3-30B-A3B","Setting":"24 turns"}. This record does not assert independent reproduction.

### Prompt-init

Alignment Score: 0.344. Result ID: 69fdbab147f34ce924e153b0.

[Reporting paper](<https://www.sota2.com/research/paper/69fd6e1c5497b3b670c89492.md>)

Recorded evaluation configuration: {"Model":"Qwen3-30B-A3B","Setting":"24 turns"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.