Image-to-Video Generation on Cosmos HUE PAIBench-G
94.4Overall ScoreReal video GT (PAI-Bench)
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Real video GT (PAI-Bench)Type=—, Conditioning=image conditioning2026.06 | 94.4 | 94.8 | 93.2 | 95.1 | 95.4 | 94.2 | 96 | 94.9 | 93.4 | 92.1 | 96.3 | 98.1 | |
| Veo-3.1Type=Closed-sourced, Conditioning=image conditioning2026.06 | 89.7 | 90.3 | 87.7 | 89.2 | 93.2 | 92.3 | 86 | 88.6 | 93.4 | 87.2 | 91.2 | 94.3 | |
| Cosmos3-SuperType=Open-sourced, Conditioning=image conditioning2026.06 | 89.6 | 90.3 | 87.5 | 87 | 94.2 | 90.7 | 86.2 | 91.1 | 89.6 | 87.1 | 91.5 | 94.8 | |
| Cosmos3-NanoType=Open-sourced, Conditioning=image conditioning2026.06 | 88.6 | 89.2 | 86.4 | 86.3 | 93.5 | 90.6 | 87.6 | 90.6 | 88 | 84.7 | 91 | 93.9 | |
| Wan2.2-A14BType=Open-sourced, Conditioning=image conditioning2026.06 | 88.4 | 88.6 | 86 | 85.7 | 93.5 | 90.1 | 84.7 | 84.8 | 92 | 86.5 | 91.9 | 92.5 | |
| Seedance-1.5-ProType=Closed-sourced, Conditioning=image conditioning2026.06 | 87.6 | 87.7 | 85.4 | 86.5 | 91.8 | 89.5 | 82.9 | 85.7 | 90.6 | 85.7 | 90.6 | 93 | |
| HunyuanVideo-1.5Type=Open-sourced, Conditioning=image conditioning2026.06 | 85.6 | 87.1 | 80.8 | 83 | 92.5 | 90 | 81.7 | 77.2 | 89.6 | 85.2 | 89.5 | 91.8 | |
| Wan2.1-14BType=Open-sourced, Conditioning=image conditioning2026.06 | 83.9 | 85 | 80.2 | 80.6 | 91.2 | 88.1 | 76.8 | 74.8 | 89.9 | 84.3 | 85.8 | 93.2 | |
| Cosmos-Predict2.5-14BType=Open-sourced, Conditioning=image conditioning2026.06 | 83 | 85 | 77.9 | 77.5 | 92.4 | 88.1 | 85.2 | 78.4 | 83 | 78.5 | 84.8 | 93.2 | |
| Cosmos-Predict2.5-2BType=Open-sourced, Conditioning=image conditioning2026.06 | 82.6 | 86.1 | 77.3 | 78.2 | 90.2 | 85.6 | 86 | 79 | 85.6 | 77.1 | 85.1 | 92.4 | |
| Wan2.2-5BType=Open-sourced, Conditioning=image conditioning2026.06 | 80.4 | 83.4 | 74.6 | 75.7 | 89.5 | 86.1 | 74.3 | 68.6 | 88.4 | 79.6 | 84.8 | 90.5 |