Video Generation on VBench (Imaging, Aesthetic, Motion, and Consistency Metrics)
65.14Imaging QualityBF16
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| BF16Model=Wan 14B, Bit=16/162026.07 | 65.14 | 61.36 | 97.38 | 73.89 | 96.32 | 93.65 | 33.3 | 26.29 | |
| BF16Model=HunyuanVideo, Bit=16/162026.07 | 64.78 | 62.53 | 99.3 | 51.39 | 97.01 | 96.05 | 42.81 | 25.86 | |
| OrbitQuantModel=Wan 14B, Bit=W4A42026.07 | 64.05 | 60.22 | 97.54 | 62.5 | 95.59 | 93.63 | 32.85 | 26.15 | |
| QuaRotModel=Wan 14B, Bit=W4A42026.07 | 63.32 | 56.86 | 97.01 | 55 | 95.04 | 91.85 | 25.89 | 25.41 | |
| OrbitQuantModel=HunyuanVideo, Bit=W4A42026.07 | 62.09 | 60.72 | 99.3 | 44.17 | 97.51 | 96.22 | 30.52 | 22.83 | |
| DVD-QuantModel=HunyuanVideo, Bit=W4A42026.07 | 61.82 | 61.96 | 99.15 | 56.94 | 97.82 | 96.61 | 29.94 | 25.68 | |
| SmoothQuantModel=Wan 14B, Bit=W4A42026.07 | 59.71 | 52.63 | 97.63 | 44.72 | 93.9 | 91.71 | 14.39 | 23.27 | |
| ViDiT-QModel=Wan 14B, Bit=W4A42026.07 | 59.48 | 53.73 | 96.72 | 54.17 | 95.33 | 92.02 | 18.49 | 24.32 | |
| SmoothQuantModel=HunyuanVideo, Bit=W4A42026.07 | 59.46 | 48.41 | 98.79 | 1.39 | 96.72 | 94.97 | 7.84 | 21.09 | |
| QuaRotModel=HunyuanVideo, Bit=W4A42026.07 | 54.3 | 44.85 | 92.22 | 87.5 | 97.69 | 92.64 | 0.94 | 17.33 | |
| ViDiT-QModel=HunyuanVideo, Bit=W4A42026.07 | 40.1 | 45.36 | 99.43 | 0 | 97.19 | 97.29 | 7.85 | 19.66 |