Video Generation on FilMaster evaluation suite
4Script Faithfulness (SF)CANVAS
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| CANVASI2V Model=Veo-3.12026.04 | 4 | 3 | 4.75 | 4 | 3.25 | 5 | 4.75 | 4.75 | — | |
| Story-IterI2V Model=Veo-3.12026.04 | 3.75 | 2.25 | 3.75 | 2 | 3.75 | 4.5 | 4.25 | 4.25 | — | |
| Gemini-CTI2V Model=Veo-3.12026.04 | 3.75 | 2.25 | 4.25 | 2.5 | 3.5 | 4.25 | 4 | 4 | — | |
| Story2BoardI2V Model=Veo-3.1, Evaluator=Gemini-2.5-Flash2026.04 | 3.6 | 2.2 | 1.8 | 1 | 3.6 | 2.2 | 3.4 | 3.2 | 2.63 | |
| CANVASI2V Model=Veo-3.1, Evaluator=Gemini-2.5-Flash2026.04 | 3.4 | 4 | 3.8 | 4 | 3.8 | 4 | 4.4 | 4.8 | 4.03 | |
| StoryIterI2V Model=Veo-3.1, Evaluator=Gemini-2.5-Flash2026.04 | 3.2 | 2.6 | 3.4 | 1.8 | 4.4 | 2.8 | 4 | 2.8 | 3.13 | |
| AutoStudioI2V Model=Veo-3.1, Evaluator=Gemini-2.5-Flash2026.04 | 3 | 2.8 | 3.2 | 2 | 3.5 | 3 | 3.5 | 3.2 | 3.03 | |
| Gemini-CTI2V Model=Veo-3.1, Evaluator=Gemini-2.5-Flash2026.04 | 3 | 2.2 | 3.6 | 2.2 | 3.8 | 3.6 | 3.8 | 4.4 | 3.33 | |
| Story2BoardI2V Model=Veo-3.12026.04 | 2.25 | 1.75 | 1.75 | 1 | 3 | 2.75 | 2.75 | 2.25 | — |