Video Editing on OpenVE-Bench
3.51Overall ScoreRunway Aleph
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Runway AlephAccess=Closed-source2026.05 | 3.51 | — | — | — | — | — | — | |
| Runway Aleph#Reso.=1280×7202026.03 | 3.49 | 3.72 | 2.62 | 4.18 | 4.16 | 2.78 | — | |
| Aurora2026.05 | 3.38 | — | — | — | — | — | — | |
| OmniWeaving#Params=8.3B+7B2026.03 | 3.15 | 3.91 | 2.3 | 3.65 | 3.22 | 2.3 | 3.53 | |
| VINO#Params=13B+4B2026.03 | 3.11 | 4.32 | 2.37 | 3.65 | 3.19 | 2.71 | 2.94 | |
| UniVideo2026.05 | 3.1 | — | — | — | — | — | — | |
| UniVideo(hidden)#Params=13B+7B2026.03 | 3.09 | 3.55 | 2.42 | 3.67 | 2.89 | 2.9 | 2.99 | |
| UniVideo(query)#Params=13B+7B2026.03 | 3.05 | 3.47 | 2.47 | 3.86 | 2.48 | 2.87 | 3.13 | |
| Kiwi-EditStage=Stage-3 Instruct-Reference, #Params.=5B, #Reso.=1280 × 7042026.03 | 3.02 | 3.64 | 2.64 | 3.83 | 2.63 | 2.36 | — | |
| Kiwi-EditStage=Stage-2 Instruct-Only, #Params.=5B, #Reso.=1280 × 7042026.03 | 2.98 | 3.54 | 3.84 | 2.57 | 2.71 | 2.25 | — | |
| Kiwi-EditStage=Stage-2 Instruct-Only, #Params.=5B, #Reso.=720 × 4802026.03 | 2.92 | 3.54 | 3.8 | 2.59 | 2.55 | 2.12 | — | |
| SANA-Streaming#Params.=2B, #Reso.=1280x704, Latency (s)=20, Throughput (FPS)=32.42026.05 | 2.62 | 3.48 | 2.29 | 3.2 | 2.27 | 1.88 | — | |
| OpenVE-Edit#Params=5B2026.03 | 2.57 | 3.16 | 2.36 | 2.98 | 1.85 | 2.15 | 2.91 | |
| OpenVE-Edit2026.05 | 2.57 | — | — | — | — | — | — | |
| OpenVE-Edit#Params.=5B, #Reso.=1280×7042026.03 | 2.5 | 3.16 | 2.36 | 2.98 | 1.85 | 2.15 | — | |
| OpenVE-Edit#Params.=5B, #Reso.=1280x704, Latency (s)=97, Throughput (FPS)=6.72026.05 | 2.5 | 3.16 | 2.36 | 2.98 | 1.85 | 2.15 | — | |
| SANA-Streaming#Params.=2B, #Reso.=1280x704, Latency (s)=1, Throughput (FPS)=762.8, step distilled=true2026.05 | 2.42 | 3.6 | 1.82 | 3.1 | 1.78 | 1.82 | — | |
| Ditto#Params=14B2026.03 | 2.25 | 4.01 | 1.68 | 2.03 | 1.53 | 1.41 | 2.81 | |
| Ditto2026.05 | 2.25 | — | — | — | — | — | — | |
| Lucy-Edit#Params.=5B, #Reso.=1280×7042026.03 | 2.22 | 2.27 | 1.57 | 3.2 | 1.75 | 2.3 | — | |
| Lucy-Edit#Params.=5B, #Reso.=1280x704, Latency (s)=97, Throughput (FPS)=6.72026.05 | 2.22 | 2.27 | 1.57 | 3.2 | 1.75 | 2.3 | — | |
| ICVE#Params.=13B, #Reso.=384×2402026.03 | 2.18 | 2.22 | 1.62 | 2.57 | 2.51 | 1.97 | — | |
| ICVE#Params.=13B, #Reso.=384x240, Latency (s)=6051, Throughput (FPS)=0.22026.05 | 2.18 | 2.22 | 1.62 | 2.57 | 2.51 | 1.97 | — | |
| ICVE#Params=13B2026.03 | 2.16 | 2.22 | 1.62 | 2.57 | 2.51 | 1.97 | 2.09 | |
| DITTO#Params.=14B, #Reso.=832×4802026.03 | 2.13 | 4.01 | 1.68 | 2.03 | 1.53 | 1.41 | — | |
| DITTO#Params.=14B, #Reso.=832x480, Latency (s)=1971, Throughput (FPS)=0.32026.05 | 2.13 | 4.01 | 1.68 | 2.03 | 1.53 | 1.41 | — | |
| Lucy-Edit#Params=5B2026.03 | 2.12 | 2.27 | 1.57 | 3.2 | 1.75 | 2.3 | 1.61 | |
| LucyEditDev2026.05 | 2.12 | — | — | — | — | — | — | |
| InsViE#Params=2B2026.03 | 1.58 | 2.2 | 1.06 | 1.48 | 1.36 | 1.17 | 2.18 | |
| InsViE2026.05 | 1.58 | — | — | — | — | — | — | |
| VACE#Params.=14B, #Reso.=1280×7202026.03 | 1.57 | 1.49 | 1.55 | 2.07 | 1.46 | 1.26 | — | |
| VACE#Params.=14B, #Reso.=1280x720, Latency (s)=1991, Throughput (FPS)=0.32026.05 | 1.57 | 1.49 | 1.55 | 2.07 | 1.46 | 1.26 | — | |
| VACE#Params=14B2026.03 | 1.55 | 1.49 | 1.55 | 2.07 | 1.46 | 1.26 | 1.48 | |
| VACE2026.05 | 1.55 | — | — | — | — | — | — | |
| InsViE#Params.=2B, #Reso.=720×4802026.03 | 1.45 | 2.2 | 1.06 | 1.48 | 1.36 | 1.17 | — | |
| InsViE#Params.=2B, #Reso.=720x480, Latency (s)=750, Throughput (FPS)=0.92026.05 | 1.45 | 2.2 | 1.06 | 1.48 | 1.36 | 1.17 | — | |
| OmniVideo#Params.=1.3B, #Reso.=640×3522026.03 | 1.19 | 1.11 | 1.18 | 1.14 | 1.14 | 1.36 | — | |
| OmniVideo#Params.=1.3B, #Reso.=640x3522026.05 | 1.19 | 1.11 | 1.18 | 1.14 | 1.14 | 1.36 | — | |
| OmniVideo#Params=1.3B2026.03 | 1.16 | 1.11 | 1.18 | 1.14 | 1.14 | 1.36 | 1 |