VBench
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
VBench 2.0 (overall)
0.618Total Score
4
VBench subcategories
0.687Imaging Quality
4
VBench-Long 30s
98.7Subject Consistency
4
VBench extended
96.28Object Class
4
VBench extended prompts (test)
96.98Subject Consistency
4
VBench 50s long videos
87.59Motion Quality
4
VBench ModelScope (MS) (test)
100Bit Accuracy
4
VBench real-world
92.25Subject Consistency
4
VBench Wan 5B 93x704x1280 2.2 (test)
65.04Aesthetic Quality (AQ)
4
VBench Wan2.1 14B, 93x704x1280 1.0 (test)
67.49AQ
4
VBench Hunyuan-13B Text-to-Video 720P
0.956VBench S.C.
4
VBench Wan2.1-1.3B Text-to-Video 480P
94.96VBench S.C.
4
VBench 5-second video generation
97Subject Consistency
4
VBench 60 generated videos
63.5Overall Video Quality
4
VBench Single Subject (test)
73.2CLIP-I
4
VBench Slow Motion
96.65Subject Consistency
3
VBench Dolly Zoom
98.56Subject Consistency
3
VBench Bullet Time
95.33Subject Consistency
3
VBench
82Object Class Fidelity
3
VBench Optimization: CogVideoX, Generation: LTX-Video (unseen prompts)
4.64Subject Preservation Score
3
VBench Optimization: LTX-Video, Generation: CogVideoX unseen prompts
4.86Subject Preservation
3
VBench
0.968Background Consistency
3
VBench 100 unseen in-the-wild videos 32
89.4Subject Consistency
3
VBench-Long
73.85Imaging Quality
3
VBench 50 prompts
139Ours Wins
3