# Multi-shot Video Generation on 20 evaluation prompts 1.0 (User Study)

Source: [Multi-shot Video Generation on 20 evaluation prompts 1.0 (User Study)](<https://www.sota2.com/research/sota/multi-shot-video-generation-on-20-evaluation-prompts-1-0-user-study>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-04T08:04:02.456Z

Human evaluation of multi-shot video generation models using the '20 evaluation prompts 1.0 (User Study)' dataset, focusing on metrics like transition control and temporal consistency.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Multi-shot Video Generation |
| Dataset (including any stated split) | 20 evaluation prompts 1.0 (User Study) |
| Metric | Temporal Consistency Score |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 7 of 7 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Temporal Consistency Score](<https://www.sota2.com/research/sota/multi-shot-video-generation-on-20-evaluation-prompts-1-0-user-study.md?metric=Temporal%20Consistency%20Score>): Higher is better; unit: SCALAR.

- [Transition Control Score](<https://www.sota2.com/research/sota/multi-shot-video-generation-on-20-evaluation-prompts-1-0-user-study.md?metric=Transition%20Control%20Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Temporal Consistency Score | Result date | Report paper |
| --- | --- | --- | --- |
| CineTrans-DiT | 4.15 | Not recorded | 68fa7ab41e209131cea84b40 |
| CineTrans-Unet | 4.1 | Not recorded | 68fa7ab41e209131cea84b40 |
| StoryDiffusion+CogVideoXI2V | 3.95 | Not recorded | 68fa7ab41e209131cea84b40 |
| HunyuanVideo+Cinematron | 3.8 | Not recorded | 68fa7ab41e209131cea84b40 |
| HunyuanVideo | 3.5 | Not recorded | 68fa7ab41e209131cea84b40 |
| Wanx2.1-T2V-turbo | 3.45 | Not recorded | 68fa7ab41e209131cea84b40 |
| CogVideoX | 3.05 | Not recorded | 68fa7ab41e209131cea84b40 |

### CineTrans-DiT

Temporal Consistency Score: 4.15. Result ID: 69a7e6066dbb7075b94c934e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ab41e209131cea84b40.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ab41e209131cea84b40.md>)

Recorded evaluation configuration: {"Architecture":"DiT"}. This record does not assert independent reproduction.

### CineTrans-Unet

Temporal Consistency Score: 4.1. Result ID: 69a7e6066dbb7075b94c934f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ab41e209131cea84b40.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ab41e209131cea84b40.md>)

Recorded evaluation configuration: {"Architecture":"Unet"}. This record does not assert independent reproduction.

### StoryDiffusion+CogVideoXI2V

Temporal Consistency Score: 3.95. Result ID: 69a7e6066dbb7075b94c9350.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ab41e209131cea84b40.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HunyuanVideo+Cinematron

Temporal Consistency Score: 3.8. Result ID: 69a7e6066dbb7075b94c9351.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ab41e209131cea84b40.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HunyuanVideo

Temporal Consistency Score: 3.5. Result ID: 69a7e6066dbb7075b94c9352.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ab41e209131cea84b40.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77581e209131cea72919.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Wanx2.1-T2V-turbo

Temporal Consistency Score: 3.45. Result ID: 69a7e6066dbb7075b94c9354.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ab41e209131cea84b40.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78241e209131cea76f7d.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### CogVideoX

Temporal Consistency Score: 3.05. Result ID: 69a7e6066dbb7075b94c9353.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ab41e209131cea84b40.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77a01e209131cea74741.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
