Video Generation on VBench (8 Perceptual Metrics Subset)
59.22Aesthetic QualityOriginal
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| OriginalBit-width (W/A)=W16/A16, Model=CogVideo-5B2026.03 | 59.22 | 95.7 | 25.95 | 69.44 | 95.05 | 60.79 | 46.08 | 97.6 | |
| Ours (DMPQ)Bit-width (W/A)=W4A6, Model=CogVideo-5B2026.03 | 57.24 | 95.98 | 24.92 | 63.89 | 94.54 | 56.37 | 45.13 | 97.05 | |
| OriginalBit-width (W/A)=W16/A16, Model=CogVideo-2B2026.03 | 54.64 | 95 | 24.23 | 76.39 | 94.91 | 57.13 | 35.9 | 97.14 | |
| Ours (DMPQ)Bit-width (W/A)=W4A6, Model=CogVideo-2B2026.03 | 54.37 | 94.55 | 24.74 | 68.06 | 92.82 | 55.11 | 33.07 | 96.91 | |
| QuaRotBit-width (W/A)=W4A8, Model=CogVideo-5B2026.03 | 53.71 | 94.96 | 24.48 | 52.78 | 93.47 | 54.28 | 36.85 | 97.79 | |
| QuaRotBit-width (W/A)=W4A6, Model=CogVideo-5B2026.03 | 53.45 | 94.85 | 24.35 | 48.61 | 93.04 | 53.77 | 35.17 | 97.75 | |
| SmoothQuantBit-width (W/A)=W4A8, Model=CogVideo-2B2026.03 | 53.32 | 94.41 | 24.73 | 68.06 | 93.19 | 54.6 | 33.43 | 96.8 | |
| ViDiT-QBit-width (W/A)=W4A8, Model=CogVideo-2B2026.03 | 53.32 | 94.49 | 24.64 | 65.28 | 92.72 | 55.34 | 33.72 | 96.92 | |
| QuaRotBit-width (W/A)=W4A6, Model=CogVideo-2B2026.03 | 53 | 94.08 | 24.55 | 68.05 | 92.77 | 54.06 | 34.81 | 96.67 | |
| QuaRotBit-width (W/A)=W4A8, Model=CogVideo-2B2026.03 | 51.58 | 94.27 | 23.83 | 51.39 | 92.02 | 52.58 | 26.82 | 97.15 | |
| SmoothQuantBit-width (W/A)=W4A8, Model=CogVideo-5B2026.03 | 51.48 | 95.02 | 23.55 | 47.22 | 92.3 | 51.15 | 25.22 | 97.96 | |
| SmoothQuantBit-width (W/A)=W4A6, Model=CogVideo-2B2026.03 | 50.1 | 94.44 | 23.48 | 44.44 | 91.41 | 51.18 | 23.91 | 97.14 | |
| SmoothQuantBit-width (W/A)=W4A6, Model=CogVideo-5B2026.03 | 49.5 | 94.99 | 23.51 | 41.67 | 91.62 | 50.09 | 19.33 | 97.91 | |
| ViDiT-QBit-width (W/A)=W4A6, Model=CogVideo-2B2026.03 | 47.45 | 94.7 | 22.02 | 37.5 | 90.86 | 47.01 | 17.66 | 97.25 | |
| ViDiT-QBit-width (W/A)=W4A8, Model=CogVideo-5B2026.03 | 45.25 | 96.06 | 20.36 | 22.22 | 91.11 | 43.55 | 8.79 | 98.18 | |
| ViDiT-QBit-width (W/A)=W4A6, Model=CogVideo-5B2026.03 | 44.33 | 96.17 | 20.34 | 16.67 | 91.1 | 42.6 | 7.84 | 98.19 |