Cinematography Language Understanding on ShotBench (test)
77.9Shot Sequence ScoreShotVL
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| ShotVLParameters=3B2025.06 | 77.9 | 85.6 | 68.8 | 59.3 | 65.7 | 53.1 | 57.4 | 51.7 | 65.1 | |
| Qwen2.5-VL-72B-InstructParameters=72B2025.06 | 75.1 | 82.9 | 56.7 | 46.8 | 59 | 49.4 | 54.1 | 48.9 | 59.1 | |
| GPT-4o2025.06 | 69.3 | 83.1 | 58.2 | 48.9 | 63.2 | 48 | 55.2 | 48.3 | 59.3 | |
| Qwen2.5-VL-3B-InstructParameters=3B2025.06 | 54.6 | 56.6 | 43.1 | 36.6 | 59.3 | 45.1 | 41.5 | 31.9 | 46.1 |