Video Editing on OpenVE-Bench (test)
4.34Overall ScoreVInO
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| VInOEvaluation Judge=Qwen3VL2026.01 | 4.34 | 4.78 | 4.46 | 4.41 | 4.45 | 4.43 | 3.39 | 4.6 | 4.08 | — | |
| OpenVE-EditEvaluation Judge=Qwen3VL2026.01 | 3.89 | 4.24 | 4.1 | 3.8 | 3.5 | 3.41 | 3.98 | 3.71 | 3.25 | — | |
| Lucy-EditEvaluation Judge=Qwen3VL2026.01 | 3.77 | 3.64 | 3.25 | 3.93 | 3.95 | 3.92 | 4.23 | 4.19 | 3.54 | — | |
| ICVEEvaluation Judge=Qwen3VL2026.01 | 3.76 | 3.87 | 3.51 | 3.87 | 4.5 | 3.77 | 4.68 | 3.54 | 2.84 | — | |
| Runway AlephScale=≥ 14B2026.05 | 3.71 | — | — | — | 4.16 | 2.78 | — | — | — | 4.18 | |
| OmniVideoEvaluation Judge=Qwen3VL2026.01 | 3.66 | 3.41 | 4.11 | 3.75 | 4.52 | 2.8 | 4.95 | 1.13 | 3.62 | — | |
| DittoEvaluation Judge=Qwen3VL2026.01 | 3.44 | 4.48 | 3.52 | 2.89 | 3.53 | 2.48 | 3.69 | 4.14 | 3.33 | — | |
| SAMAScale=≥ 14B, Size=14B2026.05 | 3.26 | — | — | — | 3.32 | 2.54 | — | — | — | 3.93 | |
| InsViEEvaluation Judge=Qwen3VL2026.01 | 3.25 | 3.63 | 2.68 | 2.82 | 3.56 | 2.25 | 4.77 | 3.36 | 3.61 | — | |
| VINOEvaluator Model=Gemini 2.5 pro2026.01 | 3.18 | 4.34 | 2.54 | 3.73 | 3.22 | 2.77 | 2.61 | 3.29 | 2.81 | — | |
| ORVEScale=< 14B, Size=1.3B2026.05 | 3.16 | — | — | — | 2.98 | 2.62 | — | — | — | 3.87 | |
| VACE-14BEvaluation Judge=Qwen3VL2026.01 | 3.01 | 3.46 | 2.81 | 2.47 | 3.99 | 1.76 | 4.41 | 2.17 | 3.09 | — | |
| KiwiEdit-instruct-onlyScale=< 14B, Size=5B+3B2026.05 | 2.51 | — | — | — | 2.71 | 2.25 | — | — | — | 2.57 | |
| OpenVE-EditEvaluator Model=Gemini 2.5 pro2026.01 | 2.49 | 3.16 | 2.36 | 2.98 | 1.85 | 2.15 | 2.91 | 2.31 | 2.02 | — | |
| Lucy-EditScale=< 14B, Size=5B2026.05 | 2.42 | — | — | — | 1.75 | 2.3 | — | — | — | 3.2 | |
| ReCoScale=< 14B, Size=1.3B2026.05 | 2.42 | — | — | — | 2.96 | 1.96 | — | — | — | 2.35 | |
| ICVEScale=< 14B, Size=13B2026.05 | 2.35 | — | — | — | 2.51 | 1.97 | — | — | — | 2.57 | |
| DITTOScale=≥ 14B, Size=14B2026.05 | 2.33 | — | — | — | 1.85 | 2.15 | — | — | — | 2.98 | |
| OpenVE-EditScale=< 14B, Size=5B2026.05 | 2.33 | — | — | — | 1.85 | 2.15 | — | — | — | 2.98 | |
| Lucy-EditEvaluator Model=Gemini 2.5 pro2026.01 | 2.15 | 2.27 | 1.57 | 3.2 | 1.75 | 2.3 | 1.61 | 2.86 | 1.61 | — | |
| ICVEEvaluator Model=Gemini 2.5 pro2026.01 | 2.07 | 2.22 | 1.62 | 2.57 | 2.51 | 1.97 | 2.09 | 2.41 | 1.11 | — | |
| DittoEvaluator Model=Gemini 2.5 pro2026.01 | 1.98 | 4.01 | 1.68 | 2.03 | 1.53 | 1.41 | 2.81 | 1.23 | 1.32 | — | |
| VACEScale=≥ 14B, Size=14B2026.05 | 1.6 | — | — | — | 1.46 | 1.26 | — | — | — | 2.07 | |
| VACE-14BEvaluator Model=Gemini 2.5 pro2026.01 | 1.57 | 1.49 | 1.55 | 2.07 | 1.46 | 1.26 | 1.48 | 1.47 | 1.62 | — | |
| InsViEEvaluator Model=Gemini 2.5 pro2026.01 | 1.53 | 2.2 | 1.06 | 1.48 | 1.36 | 1.17 | 2.18 | 2.02 | 1.09 | — | |
| InsViEScale=< 14B, Size=2B2026.05 | 1.34 | — | — | — | 1.36 | 1.17 | — | — | — | 1.48 | |
| OmniVideoEvaluator Model=Gemini 2.5 pro2026.01 | 1.31 | 1.11 | 1.18 | 1.14 | 1.14 | 1.36 | 1 | 2.26 | 1 | — | |
| OmniVideoScale=< 14B, Size=1.3B2026.05 | 1.21 | — | — | — | 1.14 | 1.36 | — | — | — | 1.14 |