Instruction-only Video Editing (Remove) on VIE-Bench
9.86Instruction Following ScoreRunway
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| RunwayCategory=Instruction-only, Task=Remove2025.12 | 9.86 | 10 | 9.51 | 9.79 | 97.62 | 98 | 20.5 | 24.35 | 24.82 | |
| OursCategory=Instruction-only, Task=Remove2025.12 | 9.37 | 10 | 8.96 | 9.44 | 97.17 | 96.94 | 20.45 | 24.36 | 24.91 | |
| ICVECategory=Instruction-only, Task=Remove2025.12 | 7.24 | 8.68 | 5.2 | 7.04 | 97.39 | 97.4 | 19.98 | 22.95 | 23.3 | |
| Lucy-Edit-DevCategory=Instruction-only, Task=Remove2025.12 | 6.65 | 5 | 3.34 | 5 | 96.58 | 96.12 | 19.37 | 21.1 | 18.43 | |
| InsV2VCategory=Instruction-only, Task=Remove2025.12 | 5.34 | 6.72 | 2.03 | 4.7 | 95.97 | 95.7 | 19.32 | 21.56 | 18.76 | |
| DittoCategory=Instruction-only, Task=Remove2025.12 | 4.27 | 4.27 | 3.72 | 4.09 | 97.18 | 96.99 | 19.15 | 20.44 | 15.63 |