Image-to-Video on VBench I2V (Detailed Consistency and Quality Metrics)
82.44Quality Overall ScoreMagi-1
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Magi-1Model Access=Open Source Models2025.07 | 82.44 | 89.28 | 96.12 | 93.96 | 96.74 | 98.68 | 68.21 | 64.74 | 69.71 | 98.39 | 99 | 50.85 | |
| Step-Video-TI2VModel Access=Open Source Models2025.07 | 81.22 | 88.36 | 95.5 | 96.02 | 97.06 | 99.24 | 48.78 | 62.29 | 70.44 | 97.86 | 98.63 | 49.23 | |
| Gen-4-I2V (API)Model Access=Closed / Proprietary Models2025.07 | 80.89 | 88.27 | 95.65 | 93.23 | 96.79 | 98.99 | 55.2 | 61.77 | 70.41 | 97.84 | 97.46 | 68.26 | |
| Wan-I2VModel Access=Open Source Models2025.07 | 80.82 | 86.86 | 92.9 | 94.86 | 97.07 | 97.9 | 51.38 | 64.75 | 70.44 | 96.95 | 96.44 | 34.76 | |
| DynamiCrafter-512Model Access=Open Source Models2025.07 | 80.46 | 86.99 | 93.53 | 93.81 | 96.64 | 96.84 | 69.67 | 60.88 | 68.6 | 97.21 | 97.4 | 31.98 | |
| SVD-XT-1.0Model Access=Open Source Models2025.07 | 80.11 | — | — | 95.52 | 96.61 | 98.09 | 52.36 | 60.15 | 69.8 | 97.52 | 97.63 | — | |
| STIV (Apple)Model Access=Closed / Proprietary Models2025.07 | 79.98 | 86.73 | 93.48 | 98.4 | 98.39 | 99.61 | 15.28 | 66 | 70.81 | 98.96 | 97.35 | 11.17 | |
| Pusa (Ours)Model Access=Open Source Models, Zero-shot=true2025.07 | 79.8 | 87.32 | 94.84 | 92.27 | 96.02 | 98.49 | 52.6 | 63.15 | 68.27 | 97.64 | 99.24 | 29.46 | |
| SVD-XT-1.1Model Access=Open Source Models2025.07 | 79.4 | — | — | 95.42 | 96.77 | 98.12 | 43.17 | 60.23 | 70.23 | 97.51 | 97.62 | — | |
| VideoCrafterModel Access=Open Source Models2025.07 | 78.84 | 82.57 | 86.31 | 97.86 | 98.79 | 98 | 22.6 | 60.78 | 71.68 | 91.17 | 91.31 | 33.6 | |
| Animate-AnythingModel Access=Open Source Models2025.07 | 78.71 | 86.48 | 94.25 | 98.9 | 98.19 | 98.61 | 2.68 | 67.12 | 72.09 | 98.76 | 98.58 | 13.08 | |
| CogVideoX-5b-I2VModel Access=Open Source Models2025.07 | 78.61 | 86.7 | 94.79 | 94.34 | 96.42 | 98.4 | 33.17 | 61.87 | 70.01 | 97.19 | 96.74 | 67.68 | |
| I2VGen-XLModel Access=Open Source Models2025.07 | 78.44 | 85.28 | 92.11 | 94.18 | 97.09 | 98.34 | 26.1 | 64.82 | 69.14 | 96.48 | 96.83 | 18.48 | |
| SEINE-512x512Model Access=Open Source Models2025.07 | 78.37 | 85.52 | 92.67 | 95.28 | 97.12 | 97.12 | 27.07 | 64.55 | 71.39 | 97.15 | 96.94 | 20.97 | |
| ConsistI2VModel Access=Open Source Models2025.07 | 76.22 | 84.07 | 91.91 | 95.27 | 98.28 | 97.38 | 18.62 | 59 | 66.92 | 95.82 | 95.95 | 33.92 | |
| CogVideoX1.5-5BModel Access=Open Source Models2025.07 | 50.9 | 71.58 | 92.25 | 91.8 | 94.66 | 40.98 | 62.29 | 70.21 | 97.07 | 96.46 | 95.5 | 39.71 |