Video Generation on VBench CogVideoX-2B
60.16Imaging QualityQVGen
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| QVGenQuantization Protocol=QAT, W/A precision=W4A42026.07 | 60.16 | 54.61 | 98.06 | 67.22 | 94.38 | 93.01 | 31.42 | 24.61 | |
| Full Prec.Quantization Protocol=—, W/A precision=16/162026.07 | 59.15 | 54.49 | 97.43 | 67.78 | 94.79 | 92.82 | 36.24 | 25.06 | |
| LSQQuantization Protocol=QAT, W/A precision=W4A42026.07 | 58.73 | 54.2 | 97.57 | 45 | 92.97 | 92.41 | 24.06 | 23.17 | |
| EfficientDMQuantization Protocol=QAT, W/A precision=W4A42026.07 | 55.96 | 51.97 | 98.03 | 46.67 | 94.1 | 91.7 | 27.76 | 24.28 | |
| Q-DMQuantization Protocol=QAT, W/A precision=W4A42026.07 | 54.96 | 52.71 | 98 | 48.61 | 93.82 | 91.86 | 28.02 | 23.87 | |
| OrbitQuantQuantization Protocol=PTQ, W/A precision=W4A42026.07 | 52.62 | 51.66 | 96.99 | 42.78 | 94.5 | 91.65 | 28.53 | 23.86 | |
| SVDQuantQuantization Protocol=PTQ, W/A precision=W4A42026.07 | 51.6 | 49.4 | 97.69 | 42.22 | 94.03 | 91.78 | 25.67 | 22.89 | |
| QuaRotQuantization Protocol=PTQ, W/A precision=W4A42026.07 | 49.6 | 47.1 | 96.9 | 9.2 | 94.8 | 90.2 | 19.7 | 21.7 | |
| ViDiT-QQuantization Protocol=PTQ, W/A precision=W4A42026.07 | 44.8 | 42.1 | 97.3 | 4.4 | 95.6 | 90.3 | 10.5 | 18.4 | |
| SmoothQuantQuantization Protocol=PTQ, W/A precision=W4A42026.07 | 39.9 | 35.5 | 97.8 | 1.9 | 95.9 | 92.9 | 3.6 | 12.8 |