Video-to-command generation on Modified Something-Something V2 (Novel Object Sets)
0.577BLEU-1Ours (Full)
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Ours (Full)Zero-shot=true2026.06 | 0.577 | 0.471 | 0.356 | 0.261 | 0.558 | 0.539 | 1.731 | |
| Intern3.5VL-4BZero-shot=true2026.06 | 0.47 | 0.341 | 0.246 | 0.181 | 0.474 | 0.414 | 0.959 | |
| ChatGPT-4o-miniZero-shot=true2026.06 | 0.444 | 0.338 | 0.24 | 0.181 | 0.485 | 0.398 | 0.912 | |
| NVILA-8BZero-shot=true2026.06 | 0.387 | 0.245 | 0.161 | 0.11 | 0.4 | 0.365 | 0.669 | |
| Qwen2.5-VL-3BZero-shot=true2026.06 | 0.361 | 0.218 | 0.155 | 0.109 | 0.383 | 0.308 | 0.633 | |
| Intern2.5VL-4BZero-shot=true2026.06 | 0.347 | 0.199 | 0.135 | 0.092 | 0.374 | 0.298 | 0.551 | |
| DeepseekVL7BZero-shot=true2026.06 | 0.329 | 0.235 | 0.166 | 0.127 | 0.343 | 0.306 | 0.558 | |
| Watch-and-ActZero-shot=true2026.06 | 0.31 | 0.157 | 0.134 | 0.107 | 0.338 | 0.209 | 0.637 | |
| Video2CommandZero-shot=true2026.06 | 0.305 | 0.15 | 0.09 | 0.082 | 0.328 | 0.203 | 0.467 | |
| V2CNetZero-shot=true2026.06 | 0.259 | 0.119 | 0.092 | 0.087 | 0.29 | 0.165 | 0.423 | |
| LLaVA-NeXT7BZero-shot=true2026.06 | 0.159 | 0.084 | 0.06 | 0.047 | 0.202 | 0.118 | 0.19 |