Subject-to-video generation on OpenS2V-Nexus (held-out set of 180 subject-text pairs)
57.05Total ScoreID-CRAFTER
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| ID-CRAFTERTraining Variant=Large-scale Model, Model Scale=14B2025.11 | 57.05 | 45.28 | 40.34 | 60.71 | 67.49 | 45.11 | 73.23 | |
| ID-CRAFTERTraining Variant=Base Model + online RL, Model Scale=1.3B2025.11 | 55.16 | 48.85 | 36.5 | 66.1 | 62.2 | 43.45 | 69.15 | |
| Kling 1.6Model Category=Proprietary2025.11 | 54.46 | 44.6 | 41.6 | 40.1 | 66.2 | 45.92 | 79.06 | |
| ID-CRAFTERTraining Variant=Base Model, Model Scale=1.3B2025.11 | 54.33 | 42.5 | 38 | 58.12 | 64.06 | 43.22 | 71.09 | |
| VACE-14BModel Category=Open-source, Parameter Count=14B2025.11 | 52.87 | 47.21 | 15.02 | 55.09 | 73.27 | 44.2 | 72.78 | |
| Phantom-14BModel Category=Open-source, Parameter Count=14B2025.11 | 52.32 | 46.39 | 33.42 | 51.48 | 70.65 | 37.43 | 68.66 | |
| Phantom-1.3BModel Category=Open-source, Parameter Count=1.3B2025.11 | 50.71 | 46.67 | 14.29 | 48.55 | 69.43 | 42.44 | 70.26 | |
| SkyReels-A2-P14BModel Category=Open-source, Parameter Count=14B2025.11 | 49.61 | 39.4 | 25.6 | 45.95 | 64.54 | 43.77 | 67.22 | |
| Pika 2.1Model Category=Proprietary2025.11 | 48.88 | 46.87 | 24.7 | 30.8 | 69.21 | 45.41 | 69.79 | |
| Vidu 2.0Model Category=Proprietary2025.11 | 47.59 | 41.47 | 13.52 | 35.11 | 67.57 | 43.55 | 71.44 | |
| VACE-1.3BModel Category=Open-source, Parameter Count=1.3B2025.11 | 45.53 | 48.24 | 18.83 | 20.58 | 71.26 | 37.95 | 71.78 |