Video Generation on VBench (8 Metrics including Consistency, Quality, FVD, LPIPS)
97.39Subject ConsistencyQ-ARVD
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Q-ARVDBitwidth=W4A62026.05 | 97.39 | 96.3 | 99.03 | 60.79 | 70.33 | 84.77 | 146.01 | 0.498 | |
| PTQ4DiTBitwidth=W8A82026.05 | 97.33 | 96.69 | 99.01 | 62.07 | 71.43 | 85.31 | 68.47 | 0.333 | |
| MinMaxBitwidth=W8A82026.05 | 97.31 | 96.64 | 98.99 | 61.83 | 71.8 | 85.31 | 77.65 | 0.351 | |
| SmoothQuantBitwidth=W8A82026.05 | 97.31 | 96.65 | 99 | 61.96 | 71.75 | 85.33 | 81.08 | 0.354 | |
| AdaroundBitwidth=W8A82026.05 | 97.29 | 96.62 | 99 | 62.03 | 71.44 | 85.28 | 68.24 | 0.334 | |
| SVDQuantBitwidth=W8A82026.05 | 97.29 | 96.67 | 99.01 | 61.97 | 71.72 | 85.33 | 74.87 | 0.349 | |
| Q-ARVDBitwidth=W8A82026.05 | 97.26 | 96.62 | 98.99 | 62.13 | 71.49 | 85.3 | 64.51 | 0.327 | |
| Bfloat16Bitwidth=16/162026.05 | 97.25 | 96.68 | 98.99 | 62.49 | 71.35 | 85.35 | 0 | 0 | |
| PTQ4DiTBitwidth=W4A82026.05 | 97.17 | 96.2 | 98.96 | 61.32 | 71.11 | 84.95 | 124.2 | 0.477 | |
| PTQ4DiTBitwidth=W4A62026.05 | 97.16 | 95.95 | 98.98 | 60.66 | 70.17 | 84.58 | 174.17 | 0.515 | |
| Q-ARVDBitwidth=W4A82026.05 | 97.05 | 96.27 | 98.95 | 61 | 70.71 | 84.8 | 116.26 | 0.466 | |
| SmoothQuantBitwidth=W4A62026.05 | 96.96 | 95.77 | 98.97 | 58.61 | 70.06 | 84.07 | 284.8 | 0.535 | |
| AdaroundBitwidth=W4A82026.05 | 96.89 | 96.05 | 98.96 | 60.79 | 70.12 | 84.56 | 156.7 | 0.474 | |
| SmoothQuantBitwidth=W4A82026.05 | 96.72 | 95.82 | 98.89 | 59.24 | 71.05 | 84.34 | 220.3 | 0.513 | |
| AdaroundBitwidth=W4A62026.05 | 96.68 | 95.59 | 99.06 | 59.79 | 67.85 | 83.79 | 224.95 | 0.515 | |
| SVDQuantBitwidth=W4A62026.05 | 96.67 | 95.71 | 98.7 | 58.29 | 70.09 | 83.89 | 215.32 | 0.542 | |
| SVDQuantBitwidth=W4A82026.05 | 96.41 | 95.56 | 98.78 | 58.62 | 70.65 | 84 | 150.03 | 0.502 | |
| MinMaxBitwidth=W4A62026.05 | 96.11 | 94.95 | 99.04 | 57.84 | 67.3 | 83.05 | 321.32 | 0.534 | |
| MinMaxBitwidth=W4A82026.05 | 95.82 | 95 | 98.92 | 58.39 | 68.53 | 83.33 | 260.14 | 0.514 |