VFX Generation on OpenVFX
4Cake-ify Quality ScoreVFX-Creator
Evaluation results
| Method | Links | |||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| VFX-CreatorMetric=Effect Class Alignment Score (CAS)2026.03 | 4 | — | — | — | — | 5 | 5 | 5 | 5 | 4.2 | 5 | 5 | 5 | 1 | 5 | 5 | 1.8 | 4.8 | 4.34 | |
| EffectMakerMetric=Effect Class Alignment Score (CAS)2026.03 | 3.6 | — | — | — | — | 4.6 | 5 | 4.2 | 5 | 3.8 | 5 | 5 | 4.6 | 4.8 | 5 | 5 | 4.2 | 5 | 4.63 | |
| EffectMakerMetric=Visual Quality (VQ)2026.03 | 3.39 | — | — | — | — | 2.94 | 3.01 | 2.99 | 1.93 | 2.23 | 2.44 | 2.17 | 3.19 | 3.7 | 2.53 | 2.79 | 3.99 | 2.46 | 2.84 | |
| Omni-EffectMetric=Visual Quality (VQ)2026.03 | 3.11 | — | — | — | — | 2.49 | 2.62 | 2.39 | 1.93 | 1.84 | 2.23 | 1.48 | 2.55 | 2.27 | 2.2 | 2.27 | 2.59 | 1.82 | 2.27 | |
| Omni-EffectMetric=Effect Class Alignment Score (CAS)2026.03 | 2.8 | — | — | — | — | 5 | 4 | 2.8 | 4.8 | 4.8 | 5 | 5 | 5 | 4 | 4.6 | 5 | 3.8 | 5 | 4.4 | |
| VFX-CreatorMetric=Visual Quality (VQ)2026.03 | 2.71 | — | — | — | — | 2.41 | 2.68 | 2.33 | 1.69 | 1.38 | 2.13 | 0.97 | 2.41 | 2.5 | 1.96 | 1.77 | 2.28 | 1.62 | 2.06 | |
| Wan2.2-FTMetric=Effect Class Alignment Score (CAS)2026.03 | 2.2 | — | — | — | — | 5 | 0 | 5 | 5 | 3 | 4.4 | 4.2 | 3 | 4.6 | 1 | 4 | 3.8 | 5 | 3.59 | |
| Wan2.2-FTMetric=Visual Quality (VQ)2026.03 | 2.15 | — | — | — | — | 1.42 | 2.63 | 2.15 | 1.64 | 0.91 | 2.23 | 1.71 | 1.89 | 2.12 | 1.74 | 2.11 | 2.04 | 1.69 | 1.89 | |
| EffectMakerMetric=Motion Quality (MQ)2026.03 | 0.59 | — | — | — | — | 0.02 | 0.11 | 0.51 | -0.06 | -0.13 | 0.73 | 0.25 | 0.09 | 0.65 | 0.26 | -0.05 | 0.52 | 0.04 | 0.25 | |
| Wan2.2-FTMetric=Motion Quality (MQ)2026.03 | 0.22 | — | — | — | — | -0.16 | 0.79 | 0.41 | 0.06 | -0.3 | 0.45 | 0.27 | 0.04 | 0.28 | 0.09 | -0.02 | 0.63 | 0.01 | 0.2 | |
| Omni-EffectMetric=Motion Quality (MQ)2026.03 | 0.12 | — | — | — | — | -0.27 | -0.08 | 0.02 | -0.09 | -0.33 | 0.04 | -0.28 | -0.11 | -0.04 | -0.14 | -0.37 | -0.09 | -0.34 | -0.14 | |
| VFX-CreatorMetric=Motion Quality (MQ)2026.03 | -0.05 | — | — | — | — | -0.15 | -0.05 | 0.13 | -0.17 | -0.35 | 0.11 | -0.26 | -0.14 | 0.48 | -0.16 | -0.41 | 0.77 | -0.21 | -0.03 | |
| Wan2.2-FTMetric=Text Alignment (TA)2026.03 | -0.56 | — | — | — | — | 1.43 | -2.2 | -2.51 | -1.38 | 0.87 | 0.75 | -1.22 | -0.04 | -1.03 | -1.5 | 0.94 | -2.62 | -0.74 | -0.7 | |
| EffectMakerMetric=Text Alignment (TA)2026.03 | -1.89 | — | — | — | — | 1.4 | -1.6 | -2.31 | -0.55 | 1.11 | 1.29 | 1 | 0.41 | -0.47 | -0.17 | 0.8 | -2.35 | -0.08 | -0.24 | |
| Omni-EffectMetric=Text Alignment (TA)2026.03 | -2.23 | — | — | — | — | 1.8 | -1.99 | -3.1 | -3.32 | 1.77 | 1.27 | 1.51 | -1.71 | -1.04 | -0.22 | 0.87 | -2.43 | 0.28 | -0.61 | |
| VFX-CreatorMetric=Text Alignment (TA)2026.03 | -2.63 | — | — | — | — | 1.54 | -1.82 | -3.38 | -3.5 | 1.44 | 0.9 | 1.51 | -2.95 | -1.29 | -0.58 | 0.99 | -3.36 | 0.26 | -0.92 |