Video Generation on EvalCrafter
70.23Visual Quality ScoreWan + SCMAPR
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Wan + SCMAPRBase Model=Wan, Refinement Method=SCMAPR2026.04 | 70.23 | 76.94 | 54.85 | 64.93 | — | — | 66.74 | |
| LaVie + SCMAPRBase Model=LaVie, Refinement Method=SCMAPR2026.04 | 68.84 | 75.42 | 53.87 | 62.56 | — | — | 65.18 | |
| Gen2Open-source=false2023.10 | 67.35 | 52.3 | 62.53 | 69.71 | — | — | — | |
| LaVie + RAPOBase Model=LaVie, Refinement Method=RAPO2026.04 | 66.62 | 74.38 | 53.34 | 61.29 | — | — | 63.91 | |
| Wan + RAPOBase Model=Wan, Refinement Method=RAPO2026.04 | 66.08 | 75.13 | 54.26 | 62.71 | — | — | 64.54 | |
| Wan + Open-SoraBase Model=Wan, Refinement Method=Open-Sora2026.04 | 65.6 | 73.84 | 53.93 | 62.43 | — | — | 63.95 | |
| LaVie + Open-SoraBase Model=LaVie, Refinement Method=Open-Sora2026.04 | 65.26 | 71.38 | 53.07 | 61.41 | — | — | 62.78 | |
| WanBase Model=Wan, Refinement Method=None2026.04 | 65.17 | 73.05 | 53.79 | 61.85 | — | — | 63.46 | |
| LaVieBase Model=LaVie, Refinement Method=None2026.04 | 64.81 | 69.6 | 53.19 | 60.87 | — | — | 62.12 | |
| Videocrafter22026.03 | 63.98 | 63.16 | 54.82 | 61.46 | 243 | — | — | |
| PikaLabOpen-source=false2023.10 | 63.52 | 54.11 | 57.74 | 69.35 | — | — | — | |
| IPO2026.03 | 62.56 | 54.62 | 53.39 | 63.4 | 234 | — | — | |
| VideoCrafterOpen-source=true, Release Version=23.102023.10 | 61.64 | 66.76 | 56.06 | 60.36 | — | — | — | |
| VideoCrafterOpen-source=true, Release Version=23.082023.10 | 59.53 | 51.29 | 51.97 | 56.36 | — | — | — | |
| 3RBase Model=LaVie2026.03 | 58.79 | 68.73 | 54.72 | 62.65 | 245 | — | — | |
| LaVie2026.03 | 57.99 | 68.49 | 52.83 | 54.23 | 234 | — | — | |
| ZeroScopeOpen-source=true2023.10 | 56.37 | 46.18 | 54.26 | 61.19 | — | — | — | |
| I2VGen-XLOpen-source=true2023.10 | 55.23 | 47.22 | 59.41 | 59.31 | — | — | — | |
| Show-12026.03 | 52.19 | 62.07 | 53.74 | 60.83 | 229 | — | — | |
| VideoCrafterOpen-source=true, Release Version=23.042023.10 | 46.88 | 41.56 | 56.24 | 55.78 | — | — | — | |
| DEMO#Params=2.3B, #Videos=10M, Evaluation Protocol=zero-shot2025.05 | 17.57 | 19.28 | 4.89 | — | — | 78.22 | — | |
| DEMO w/o L_video-motion#Params=2.3B, #Videos=10M, Evaluation Protocol=zero-shot2025.05 | 17.13 | 18.78 | 3.11 | — | — | 76.2 | — | |
| BCNI#Params=2.3B, #Videos=2M, Evaluation Protocol=CAT (ours)2025.05 | 15.28 | 99.63 | 6.45 | — | — | 65.09 | — | |
| ModelScopeT2V fine-tuned#Params=1.7B, #Videos=10M, Evaluation Protocol=zero-shot2025.05 | 14.92 | 15.89 | 2.72 | — | — | 74.23 | — | |
| Clean#Params=2.3B, #Videos=2M, Evaluation Protocol=CAT (ours)2025.05 | 14.65 | 99.66 | 4.96 | — | — | 63.9 | — | |
| ModelScopeT2V#Params=1.7B, #Videos=10M, Evaluation Protocol=zero-shot2025.05 | 14.6 | 15.12 | 2.51 | — | — | 75.88 | — | |
| Gaussian#Params=2.3B, #Videos=2M, Evaluation Protocol=CAT (ours)2025.05 | 14.57 | 99.68 | 4.75 | — | — | 60.21 | — | |
| Uniform#Params=2.3B, #Videos=2M, Evaluation Protocol=CAT (ours)2025.05 | 14.22 | 99.65 | 6.38 | — | — | 64.71 | — |