# Text-to-Video Generation on VBench standard 1.0 (test)

Source: [Text-to-Video Generation on VBench standard 1.0 (test)](<https://www.sota2.com/research/sota/text-to-video-generation-on-vbench-standard-1-0-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:04:52.428Z

Evaluation of Text-to-Video Generation models using the VBench standard 1.0 test set, assessed across detailed perceptual and consistency metrics including Subject Consistency, Temporal Flickering, Aesthetic Quality, and Total Score.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Text-to-Video Generation |
| Dataset (including any stated split) | VBench standard 1.0 (test) |
| Metric | Subject Consistency |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 7 of 7 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Subject Consistency](<https://www.sota2.com/research/sota/text-to-video-generation-on-vbench-standard-1-0-test.md?metric=Subject%20Consistency>): Higher is better; unit: PERCENT.

- [Background Consistency](<https://www.sota2.com/research/sota/text-to-video-generation-on-vbench-standard-1-0-test.md?metric=Background%20Consistency>): Higher is better; unit: PERCENT.

- [Temporal Flickering Score](<https://www.sota2.com/research/sota/text-to-video-generation-on-vbench-standard-1-0-test.md?metric=Temporal%20Flickering%20Score>): Higher is better; unit: PERCENT.

- [Motion Smoothness](<https://www.sota2.com/research/sota/text-to-video-generation-on-vbench-standard-1-0-test.md?metric=Motion%20Smoothness>): Higher is better; unit: PERCENT.

- [Aesthetic Quality](<https://www.sota2.com/research/sota/text-to-video-generation-on-vbench-standard-1-0-test.md?metric=Aesthetic%20Quality>): Higher is better; unit: PERCENT.

- [Imaging Quality](<https://www.sota2.com/research/sota/text-to-video-generation-on-vbench-standard-1-0-test.md?metric=Imaging%20Quality>): Higher is better; unit: PERCENT.

- [Dynamic Degree Score](<https://www.sota2.com/research/sota/text-to-video-generation-on-vbench-standard-1-0-test.md?metric=Dynamic%20Degree%20Score>): Higher is better; unit: PERCENT.

- [Quality Score](<https://www.sota2.com/research/sota/text-to-video-generation-on-vbench-standard-1-0-test.md?metric=Quality%20Score>): Higher is better; unit: PERCENT.

- [Total Score](<https://www.sota2.com/research/sota/text-to-video-generation-on-vbench-standard-1-0-test.md?metric=Total%20Score>): Higher is better; unit: PERCENT.

- [Object Class Accuracy](<https://www.sota2.com/research/sota/text-to-video-generation-on-vbench-standard-1-0-test.md?metric=Object%20Class%20Accuracy>): Higher is better; unit: PERCENT.

- [Multiple Objects Consistency](<https://www.sota2.com/research/sota/text-to-video-generation-on-vbench-standard-1-0-test.md?metric=Multiple%20Objects%20Consistency>): Higher is better; unit: PERCENT.

- [Human Action Fidelity](<https://www.sota2.com/research/sota/text-to-video-generation-on-vbench-standard-1-0-test.md?metric=Human%20Action%20Fidelity>): Higher is better; unit: PERCENT.

- [Color Fidelity](<https://www.sota2.com/research/sota/text-to-video-generation-on-vbench-standard-1-0-test.md?metric=Color%20Fidelity>): Higher is better; unit: PERCENT.

- [Spatial Relationship Accuracy](<https://www.sota2.com/research/sota/text-to-video-generation-on-vbench-standard-1-0-test.md?metric=Spatial%20Relationship%20Accuracy>): Higher is better; unit: PERCENT.

- [Scene Consistency](<https://www.sota2.com/research/sota/text-to-video-generation-on-vbench-standard-1-0-test.md?metric=Scene%20Consistency>): Higher is better; unit: PERCENT.

- [Appearance Style Fidelity](<https://www.sota2.com/research/sota/text-to-video-generation-on-vbench-standard-1-0-test.md?metric=Appearance%20Style%20Fidelity>): Higher is better; unit: PERCENT.

- [Temporal Style Fidelity](<https://www.sota2.com/research/sota/text-to-video-generation-on-vbench-standard-1-0-test.md?metric=Temporal%20Style%20Fidelity>): Higher is better; unit: PERCENT.

- [Overall Consistency](<https://www.sota2.com/research/sota/text-to-video-generation-on-vbench-standard-1-0-test.md?metric=Overall%20Consistency>): Higher is better; unit: PERCENT.

- [Semantic Score](<https://www.sota2.com/research/sota/text-to-video-generation-on-vbench-standard-1-0-test.md?metric=Semantic%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Subject Consistency | Result date | Report paper |
| --- | --- | --- | --- |
| LinGen | 98.3 | Not recorded | 68fa78c41e209131cea7a639 |
| LaVie-2 | 97.9 | Not recorded | 68fa78c41e209131cea7a639 |
| Runway Gen-3 | 97.1 | Not recorded | 68fa78c41e209131cea7a639 |
| Pika-1.0 | 96.94 | Not recorded | 68fa78c41e209131cea7a639 |
| VideoCrafter-2.0 | 96.85 | Not recorded | 68fa78c41e209131cea7a639 |
| OpenSora V1.2 | 96.75 | Not recorded | 68fa78c41e209131cea7a639 |
| T2V-Turbo-v2 | 95.5 | Not recorded | 68fa78c41e209131cea7a639 |

### LinGen

Subject Consistency: 98.3. Result ID: 6995a1943badfaffe69e571f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78c41e209131cea7a639.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78c41e209131cea7a639.md>)

[Implementation](<https://lineargen.github.io/>)

Recorded evaluation configuration: {"Max. Raw Frames":1088}. This record does not assert independent reproduction.

### LaVie-2

Subject Consistency: 97.9. Result ID: 6995a1943badfaffe69e571b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78c41e209131cea7a639.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70ae1e209131cea4c7e4.md>)

[Implementation](<https://vchitect.github.io/LaVie-project/>)

Recorded evaluation configuration: {"Max. Raw Frames":61}. This record does not assert independent reproduction.

### Runway Gen-3

Subject Consistency: 97.1. Result ID: 6995a1943badfaffe69e571a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78c41e209131cea7a639.md>)

Recorded evaluation configuration: {"Max. Raw Frames":256}. This record does not assert independent reproduction.

### Pika-1.0

Subject Consistency: 96.94. Result ID: 6995a1943badfaffe69e571c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78c41e209131cea7a639.md>)

Recorded evaluation configuration: {"Max. Raw Frames":72}. This record does not assert independent reproduction.

### VideoCrafter-2.0

Subject Consistency: 96.85. Result ID: 6995a1943badfaffe69e571d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78c41e209131cea7a639.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71df1e209131cea537b0.md>)

Recorded evaluation configuration: {"Max. Raw Frames":16}. This record does not assert independent reproduction.

### OpenSora V1.2

Subject Consistency: 96.75. Result ID: 6995a1943badfaffe69e571e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78c41e209131cea7a639.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76751e209131cea6d260.md>)

Recorded evaluation configuration: {"Max. Raw Frames":408}. This record does not assert independent reproduction.

### T2V-Turbo-v2

Subject Consistency: 95.5. Result ID: 6995a1943badfaffe69e5719.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78c41e209131cea7a639.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b4e1e209131cea87a59.md>)

Recorded evaluation configuration: {"Max. Raw Frames":16}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
