Instruction-Guided Video Editing on OpenVE-Bench 1.0 (full)
3.65Overall QualityRunway Aleph
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Runway Aleph#Reso.=1280x7202025.12 | 3.65 | 3.72 | 2.62 | 4.18 | 4.16 | 2.78 | 3.62 | 3.64 | 4.53 | |
| Runway Aleph#Reso.=1280x7202025.12 | 3.5 | 3.47 | 2.84 | 3.88 | 3.88 | 2.79 | 3.5 | 3.23 | 4.48 | |
| OpenVE-Edit#Params.=5B, #Reso.=1280x7042025.12 | 2.49 | 3.16 | 2.36 | 2.98 | 1.85 | 2.15 | 2.91 | 2.31 | 2.02 | |
| OpenVE-Edit#Params.=5B, #Reso.=1280x7042025.12 | 2.41 | 3.11 | 2.72 | 3.19 | 1.42 | 2.41 | 2.56 | 2.01 | 1.24 | |
| ICVE#Params.=13B, #Reso.=384x2402025.12 | 2.25 | 2.35 | 1.86 | 2.91 | 2.68 | 2.27 | 2.04 | 1.94 | 1.38 | |
| Lucy-Edit#Params.=5B, #Reso.=1280x7042025.12 | 2.15 | 2.27 | 1.57 | 3.2 | 1.75 | 2.3 | 1.61 | 2.86 | 1.61 | |
| ICVE#Params.=13B, #Reso.=384x2402025.12 | 2.07 | 2.22 | 1.62 | 2.57 | 2.51 | 1.97 | 2.09 | 2.41 | 1.11 | |
| DITTO#Params.=14B, #Reso.=832x4802025.12 | 2.06 | 3.7 | 2.23 | 2.28 | 1 | 2.08 | 1.01 | 2.61 | 1.51 | |
| DITTO#Params.=14B, #Reso.=832x4802025.12 | 1.98 | 4.01 | 1.68 | 2.03 | 1.53 | 1.41 | 2.81 | 1.23 | 1.32 | |
| Lucy-Edit#Params.=5B, #Reso.=1280x7042025.12 | 1.95 | 2.17 | 2.2 | 3.3 | 1.03 | 2.37 | 1.06 | 2.35 | 1.14 | |
| VACE#Params.=14B, #Reso.=1280x7202025.12 | 1.57 | 1.49 | 1.55 | 2.07 | 1.46 | 1.26 | 1.48 | 1.47 | 1.62 | |
| InsViE#Params.=2B, #Reso.=720x4802025.12 | 1.53 | 2.2 | 1.06 | 1.48 | 1.36 | 1.17 | 2.18 | 2.02 | 1.09 | |
| InsViE#Params.=2B, #Reso.=720x4802025.12 | 1.4 | 2.25 | 1.23 | 1.6 | 1 | 1.23 | 1.22 | 1.68 | 1.02 | |
| OmniVideo#Params.=1.3B, #Reso.=640x3522025.12 | 1.31 | 1.11 | 1.18 | 1.14 | 1.14 | 1.36 | 1 | 2.26 | 1 | |
| VACE#Params.=14B, #Reso.=1280x7202025.12 | 1.17 | 1.41 | 1.16 | 1.43 | 1 | 1.05 | 1.02 | 1.13 | 1.16 | |
| OmniVideo#Params.=1.3B, #Reso.=640x3522025.12 | 1.02 | 1.02 | 1 | 1 | 1 | 1 | 1.16 | 1 | 1 |