Instruction-only Video Editing (Replace) on VIE-Bench
9.91Instruction Following ScoreRunway
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| RunwayCategory=Instruction-only, Task=Replace2025.12 | 9.91 | 9.44 | 7.79 | 9.04 | 96.38 | 96.23 | 21.18 | 26.64 | 26.24 | |
| OursCategory=Instruction-only, Task=Replace2025.12 | 9.61 | 9.61 | 7.35 | 8.86 | 95.97 | 95.57 | 21.03 | 26.45 | 25.82 | |
| Lucy-Edit-DevCategory=Instruction-only, Task=Replace2025.12 | 8.64 | 6.38 | 3.23 | 6.08 | 95.75 | 94.84 | 20.39 | 24.54 | 24.39 | |
| ICVECategory=Instruction-only, Task=Replace2025.12 | 8.2 | 8.38 | 4.5 | 7.02 | 95.95 | 95.18 | 20.48 | 26.06 | 25.96 | |
| InsV2VCategory=Instruction-only, Task=Replace2025.12 | 6.17 | 6.29 | 3.41 | 5.29 | 95.14 | 93.78 | 20.46 | 25.15 | 24.62 | |
| DittoCategory=Instruction-only, Task=Replace2025.12 | 3.7 | 5.35 | 3.61 | 4.22 | 96.78 | 96.61 | 20.17 | 24.26 | 22.13 |